00000001:02000400:1.0F:1788925090.929835:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_hostid 00000001:02000400:1.0:1788925115.925172:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788925117.764561:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 435 MB/s 00000001:01000000:2.0:1788925118.016202:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 446 MB/s 00000001:01000000:2.0:1788925118.267186:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4474 MB/s 00000020:02000000:2.0:1788925119.444161:0:3274:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_56_gc16f486 00000400:02000000:3.0F:1788925121.506191:0:3289:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.128@tcp [8/256/0/180] 00008000:02000000:2.0:1788925125.136733:0:3439:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788925185.534688:0:5246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing load_modules_local 00000020:01000004:0.0F:1788925197.015868:0:5828:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788925197.015879:0:5828:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788925197.016005:0:5828:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000daa02c75 00000080:02000400:0.0:1788925197.016016:0:5828:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788925197.024804:0:5828:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788925197.024818:0:5828:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788925197.024935:0:5828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000860ea5b2) 00000020:00000080:1.0:1788925197.024960:0:5828:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788925197.065446:0:5828:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788925197.066028:0:5828:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788925197.101167:0:5828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788925197.101282:0:5828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788925197.101309:0:5828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788925197.101573:0:5828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788925197.101697:0:5828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788925197.102130:0:5828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788925197.102138:0:5828:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788925197.102146:0:5828:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x503aa1a44b68e1cd 00000020:01000004:1.0:1788925197.102154:0:5828:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788925197.102158:0:5828:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788925197.102163:0:5828:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000daa02c75 from MGS 00000020:01000004:1.0:1788925197.102167:0:5828:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788925197.102176:0:5828:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009723a553) 00000020:00000080:1.0:1788925197.102185:0:5828:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788925197.102315:0:5828:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000daa02c75 from MGS, refs=2 00080000:01000000:1.0:1788925197.102320:0:5828:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788925197.102490:0:5828:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x503aa1a44b68e1db 00000100:00100000:1.0:1788925197.102585:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788925197.102967:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788925197.102973:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788925197.103881:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788925197.103888:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788925197.105028:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788925197.105193:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788925197.105199:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788925197.106124:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788925197.106131:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788925197.106906:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788925197.106914:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788925197.107821:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925197.107825:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925197.107827:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925197.108677:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925197.108681:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925197.108690:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925197.109272:0:5828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788925197.110549:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788925197.358478:0:5828:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4475 MB/s 00000001:01000000:2.0:1788925197.609819:0:5828:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2298 MB/s 00000001:01000000:2.0:1788925197.859492:0:5828:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 411 MB/s 00000001:01000000:2.0:1788925198.110240:0:5828:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1419 MB/s 00080000:10000000:3.0:1788925198.116485:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1788925198.126497:0:5828:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788925198.126514:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788925198.126517:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788925198.127440:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788925198.127506:0:5828:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788925198.127552:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788925198.127742:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788925198.127777:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788925198.128083:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788925198.128480:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788925198.128486:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788925198.129005:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788925198.129012:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788925198.130735:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788925198.130744:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788925198.137798:0:5828:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788925198.137823:0:5828:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.128@tcp' 00000020:01000004:0.0:1788925198.137825:0:5828:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788925198.137876:0:5828:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.128@tcp (typ=mgc) 00000020:00000080:0.0:1788925198.137896:0:5828:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.128@tcp (00000000f5d4c85e) 00000020:00000080:0.0:1788925198.137912:0:5828:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788925198.138045:0:5828:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004ebe0afe@MGC192.168.204.128@tcp: add connection 192.168.204.128@tcp at head 00010000:00010000:0.0:1788925198.138199:0:5828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.128@tcp-0 is initialized 00000040:01000000:0.0:1788925198.138205:0:5828:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788925198.140382:0:5843:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788925198.146739:0:5844:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788925198.147200:0:5828:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.128@tcp (uuid cc4019aa-7bc2-4c01-afd8-dcb7596a337b) 00000020:00000080:0.0:1788925198.147229:0:5828:0:(genops.c:1385:class_connect()) connect: client cc4019aa-7bc2-4c01-afd8-dcb7596a337b, cookie 0x503aa1a44b68e1e9 00000100:00080000:0.0:1788925198.147242:0:5828:0:(import.c:510:import_select_connection()) MGC192.168.204.128@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788925198.147248:0:5828:0:(import.c:624:import_select_connection()) MGC192.168.204.128@tcp: import 000000004ebe0afe using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1788925198.147297:0:5828:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000115ca74 x1875823947677824/t0(0) o250->MGC192.168.204.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788925198.147325:0:5828:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cc4019aa-7bc2-4c01-afd8-dcb7596a337b->MGS 00000020:01000004:0.0:1788925198.147350:0:5828:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788925198.147361:0:5828:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788925198.147374:0:5828:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007968080f) 00000020:00000080:0.0:1788925198.147384:0:5828:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788925198.150785:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000115ca74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3304:1875823947677824:0@lo:250: 00000100:00100000:3.0:1788925198.150872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925198.151808:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947677824 00000100:00100000:3.0:1788925198.151818:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947677824 00000100:00100000:3.0:1788925198.151860:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788925198.151866:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071a2fac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1875823947677824:12345-0@lo:250: 00010000:00080000:3.0:1788925198.151892:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from cc4019aa-7bc2-4c01-afd8-dcb7596a337b@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:3.0:1788925198.151921:0:5839:0:(genops.c:1385:class_connect()) connect: client cc4019aa-7bc2-4c01-afd8-dcb7596a337b, cookie 0x503aa1a44b68e1f7 00000100:00080000:3.0:1788925198.152095:0:5839:0:(import.c:65:import_set_state_nolock()) 000000001b07a4ed : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788925198.152154:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071a2fac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+5:3304:x1875823947677824:12345-0@lo:250: Request processed in 286us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925198.152162:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788925198.152200:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.128@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788925198.152208:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.128@tcp: connect to target with instance 0 00000100:00080000:3.0:1788925198.152215:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.128@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788925198.152219:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788925198.152228:0:3304:0:(import.c:65:import_set_state_nolock()) 000000004ebe0afe MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788925198.152231:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788925198.152239:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788925198.152243:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000115ca74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3304:1875823947677824:0@lo:250: 00000100:00100000:0.0:1788925198.164603:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788925198.164896:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788925198.164903:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788925198.166237:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788925198.166248:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788925198.166827:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788925198.166834:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788925198.167580:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788925198.167868:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788925198.167873:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788925198.168482:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788925198.168489:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:0.0:1788925198.168752:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925198.207030:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788925198.207266:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788925198.207273:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788925198.209232:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788925198.209246:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788925198.209967:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925198.210159:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788925198.210165:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788925198.210745:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788925198.210752:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788925198.211521:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925198.211793:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788925198.211798:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788925198.212224:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788925198.212232:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788925198.212992:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925198.213166:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788925198.213171:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788925198.213730:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788925198.213736:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788925198.239842:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925198.240140:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788925198.240154:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788925198.243098:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788925198.243113:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788925198.243937:0:5828:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788925198.243945:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788925198.245708:0:5828:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788925198.245737:0:5828:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788925198.245744:0:5828:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788925198.245866:0:5828:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788925198.245900:0:5828:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.128@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788925198.245905:0:5828:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788925198.245907:0:5828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788925198.245909:0:5828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925198.245910:0:5828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788925198.245911:0:5828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925198.245912:0:5828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925198.245913:0:5828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788925198.245915:0:5828:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788925198.245916:0:5828:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788925198.245917:0:5828:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788925198.245918:0:5828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925198.245920:0:5828:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788925198.245922:0:5828:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788925198.245924:0:5828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788925198.245925:0:5828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788925198.245926:0:5828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925198.245927:0:5828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788925198.245928:0:5828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925198.245929:0:5828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925198.245929:0:5828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788925198.245930:0:5828:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788925198.245931:0:5828:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788925198.245932:0:5828:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788925198.245932:0:5828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925198.245933:0:5828:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788925198.245967:0:5828:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788925198.245986:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947677952:0@lo:253: 00000100:00100000:2.0:1788925198.246092:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.246194:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 000000008451dc6a going to sleep for 11 seconds 00000100:00100000:1.0:1788925198.246278:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947677952 00000100:00100000:1.0:1788925198.246286:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947677952 00000100:00100000:1.0:1788925198.246376:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925198.246385:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079f4168d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+5:5828:x1875823947677952:12345-0@lo:253: 20000000:01000000:1.0:1788925198.246460:0:5842:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788925198.246463:0:5842:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788925198.246882:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788925198.246942:0:5842:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788925198.247204:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788925198.248305:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788925198.248736:0:5842:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788925198.248741:0:5842:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788925198.248747:0:5842:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788925198.248750:0:5842:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788925198.248764:0:5842:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788925198.248953:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788925198.250916:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788925198.250942:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788925198.251068:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788925198.251121:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788925198.251157:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788925198.251270:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788925198.251279:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788925198.251337:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788925198.251346:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788925198.251383:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788925198.251390:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788925198.254860:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788925198.254960:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788925198.255041:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788925198.255049:0:5842:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788925198.255136:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788925198.255348:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788925198.255361:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788925198.255397:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788925198.255584:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788925198.255765:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788925198.255779:0:5842:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788925198.255856:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788925198.255865:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788925198.255914:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788925198.255942:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788925198.255966:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788925198.255976:0:5842:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788925198.256152:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788925198.256161:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788925198.256192:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788925198.256223:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788925198.256384:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788925198.256511:0:5842:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788925198.256519:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788925198.257964:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788925198.258850:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788925198.258951:0:5842:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.128@tcp for mdt 20000000:01000000:2.0:1788925198.258954:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:2.0:1788925198.258999:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788925198.259007:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788925198.259053:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788925198.259130:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:2.0:1788925198.259202:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788925198.259214:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788925198.259248:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788925198.259281:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788925198.259358:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788925198.259361:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788925198.259366:0:5842:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788925198.259372:0:5842:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788925198.260505:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1788925198.262164:0:5842:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788925198.276157:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788925198.276209:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788925198.276300:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788925198.276323:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788925198.276326:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788925198.276329:0:5842:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788925198.276340:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788925198.276343:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788925198.276371:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788925198.276374:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788925198.278276:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788925198.279241:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788925198.279325:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788925198.279372:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788925198.279386:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788925198.279389:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788925198.283127:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1788925198.284160:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1788925198.284208:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1788925198.284284:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1788925198.284299:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788925198.284301:0:5842:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788925198.284308:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788925198.284328:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e1fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.284518:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e1fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.284542:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e1fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.284549:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e1fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.284555:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e1fe lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.284561:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e1fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.284566:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001d0247bb already unused, calling callback (000000009f782597) 00010000:00010000:3.0:1788925198.284570:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e1fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.284576:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e1fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.284928:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e1fe lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.284937:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e1fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.284943:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e1fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788925198.284962:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788925198.617245:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079f4168d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+5:5828:x1875823947677952:12345-0@lo:253: Request processed in 370853us (371144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925198.617272:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788925198.617383:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947677952:0@lo:253: 10000000:01000000:2.0:1788925198.617438:0:5828:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788925198.617442:0:5828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788925198.617444:0:5828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788925198.617445:0:5828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925198.617446:0:5828:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788925198.617447:0:5828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925198.617448:0:5828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925198.617449:0:5828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788925198.617451:0:5828:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788925198.617452:0:5828:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788925198.617454:0:5828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925198.617455:0:5828:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788925198.617473:0:5828:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000daa02c75 from lustre-MDT0000 10000000:01000000:2.0:1788925198.617500:0:5828:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788925198.617503:0:5828:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788925198.617507:0:5828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98c844a44d28 10000000:01000000:2.0:1788925198.617511:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788925198.617518:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98c844a44d28 from 1 10000000:01000000:2.0:1788925198.617521:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788925198.617555:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000949c75c3/0x503aa1a44b68e205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.617565:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000949c75c3/0x503aa1a44b68e205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.617573:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000949c75c3/0x503aa1a44b68e205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925198.617797:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947678080:0@lo:101: 00000100:00100000:2.0:1788925198.617844:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.617900:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e1d3d42 going to sleep for 11 seconds 00000100:00100000:3.0:1788925198.617983:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947678080 00000100:00100000:3.0:1788925198.617990:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947678080 00000100:00100000:3.0:1788925198.618042:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788925198.618050:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c047d5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+5:5828:x1875823947678080:12345-0@lo:101: 00010000:00010000:3.0:1788925198.618062:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925198.618075:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e20c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e205 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.618097:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e20c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e205 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.618107:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d0247bb/0x503aa1a44b68e20c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e205 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.618116:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d0247bb, rc 0) 00000100:00100000:3.0:1788925198.618144:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c047d5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+6:5828:x1875823947678080:12345-0@lo:101: Request processed in 96us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925198.618150:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788925198.618228:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947678080:0@lo:101: 00010000:00010000:2.0:1788925198.618249:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000949c75c3/0x503aa1a44b68e205 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e20c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.618257:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000949c75c3/0x503aa1a44b68e205 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e20c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925198.618302:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947678208:0@lo:501: 00000100:00100000:2.0:1788925198.618326:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.618353:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e1d3d42 going to sleep for 11 seconds 00000100:00100000:3.0:1788925198.618416:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947678208 00000100:00100000:3.0:1788925198.618420:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947678208 00000100:00100000:3.0:1788925198.618451:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925198.618457:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad54d6f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+6:5828:x1875823947678208:12345-0@lo:501: 00000100:00100000:3.0:1788925198.618683:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad54d6f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+6:5828:x1875823947678208:12345-0@lo:501: Request processed in 227us (356us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788925198.618690:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788925198.618908:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947678208:0@lo:501: 10000000:01000000:2.0:1788925198.618935:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788925198.618950:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000949c75c3/0x503aa1a44b68e205 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e20c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.618957:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000949c75c3/0x503aa1a44b68e205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e20c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925198.618964:0:5828:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98c844c1e800 10000000:01000000:2.0:1788925198.618968:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788925198.618972:0:5828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98c844c1e800 10000000:01000000:2.0:1788925198.618974:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788925198.618977:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98c844c1e800 from 1 10000000:01000000:2.0:1788925198.618978:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788925198.618992:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000c2f00f1b/0x503aa1a44b68e213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.618998:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000c2f00f1b/0x503aa1a44b68e213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.619028:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000c2f00f1b/0x503aa1a44b68e213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925198.619038:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947678336:0@lo:101: 00000100:00100000:2.0:1788925198.619062:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.619083:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e1d3d42 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.619100:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947678336 00000100:00100000:2.0:1788925198.619105:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947678336 00000100:00100000:2.0:1788925198.619141:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788925198.619147:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d237c58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+6:5828:x1875823947678336:12345-0@lo:101: 00010000:00010000:2.0:1788925198.619156:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925198.619165:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032000d8d/0x503aa1a44b68e21a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e213 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.619179:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032000d8d/0x503aa1a44b68e21a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e213 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.619187:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032000d8d/0x503aa1a44b68e21a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e213 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.619194:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032000d8d, rc 0) 00000100:00100000:2.0:1788925198.619220:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d237c58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+7:5828:x1875823947678336:12345-0@lo:101: Request processed in 74us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925198.619226:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788925198.619257:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947678336:0@lo:101: 00010000:00010000:2.0:1788925198.619265:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000c2f00f1b/0x503aa1a44b68e213 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e21a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.619282:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000c2f00f1b/0x503aa1a44b68e213 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e21a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925198.619293:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788925198.619296:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000c2f00f1b/0x503aa1a44b68e213 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e21a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.619302:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000c2f00f1b/0x503aa1a44b68e213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e21a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925198.619307:0:5828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788925198.619310:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788925198.619315:0:5828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98c844c1e800 10000000:01000000:2.0:1788925198.619317:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788925198.619319:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788925198.619321:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788925198.619342:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000e6ddb2f3/0x503aa1a44b68e221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.619348:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000e6ddb2f3/0x503aa1a44b68e221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.619354:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000e6ddb2f3/0x503aa1a44b68e221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925198.619364:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947678464:0@lo:101: 00000100:00100000:2.0:1788925198.619387:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.619537:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e1d3d42 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.619555:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947678464 00000100:00100000:2.0:1788925198.619560:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947678464 00000100:00100000:2.0:1788925198.619646:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925198.619654:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfaa79c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+7:5828:x1875823947678464:12345-0@lo:101: 00010000:00010000:2.0:1788925198.619662:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925198.619668:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a6f62aa5/0x503aa1a44b68e228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e221 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.619680:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a6f62aa5/0x503aa1a44b68e228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e221 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.619687:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a6f62aa5/0x503aa1a44b68e228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e221 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.619693:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a6f62aa5, rc 0) 00000100:00100000:2.0:1788925198.619721:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfaa79c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+8:5828:x1875823947678464:12345-0@lo:101: Request processed in 69us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925198.619798:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925198.619829:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947678464:0@lo:101: 00010000:00010000:2.0:1788925198.619837:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000e6ddb2f3/0x503aa1a44b68e221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e228 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.619843:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000e6ddb2f3/0x503aa1a44b68e221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e228 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925198.619876:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947678592:0@lo:501: 00000100:00100000:2.0:1788925198.619897:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.619909:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e1d3d42 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.619919:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947678592 00000100:00100000:2.0:1788925198.619928:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947678592 00000100:00100000:2.0:1788925198.619946:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788925198.619951:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6ea4084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+8:5828:x1875823947678592:12345-0@lo:501: 00000100:00100000:2.0:1788925198.620137:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6ea4084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:5828:x1875823947678592:12345-0@lo:501: Request processed in 186us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925198.620143:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788925198.620173:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947678592:0@lo:501: 00000100:00100000:2.0:1788925198.620195:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947678720:0@lo:503: 00000100:00100000:2.0:1788925198.620229:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.620241:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e1d3d42 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.620252:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947678720 00000100:00100000:2.0:1788925198.620255:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947678720 00000100:00100000:2.0:1788925198.620274:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788925198.620279:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffb44438 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:5828:x1875823947678720:12345-0@lo:503: 00000100:00100000:2.0:1788925198.620955:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffb44438 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:5828:x1875823947678720:12345-0@lo:503: Request processed in 673us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925198.620963:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788925198.621041:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d679859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947678720:0@lo:503: 00000100:00100000:2.0:1788925198.621716:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b71bc51 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5871:1875823947678848:0@lo:502: 00000100:00100000:2.0:1788925198.621826:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.621896:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c26186bb going to sleep for 11 seconds 00000100:00100000:0.0:1788925198.621942:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947678848 00000100:00100000:0.0:1788925198.621947:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947678848 00000100:00100000:0.0:1788925198.622025:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788925198.622032:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3fcbecf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:5871:x1875823947678848:12345-0@lo:502: 00000100:00100000:0.0:1788925198.622247:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3fcbecf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:5871:x1875823947678848:12345-0@lo:502: Request processed in 215us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925198.622254:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788925198.622337:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b71bc51 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5871:1875823947678848:0@lo:502: 00000020:01000000:2.0:1788925198.622361:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925198.622372:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925198.622374:0:5871:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788925198.622380:0:5871:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788925198.622383:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788925198.622432:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000eb7861b1) 00000020:00000080:2.0:1788925198.622448:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788925198.622455:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788925198.622518:0:5871:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788925198.622525:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x503aa1a44b68e236 00000020:00000080:2.0:1788925198.622962:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788925198.622968:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925198.622972:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925198.622973:0:5871:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788925198.622976:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925198.622979:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925198.622980:0:5871:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788925198.622983:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788925198.622989:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005357fafc) 00000020:00000080:2.0:1788925198.622999:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788925198.623003:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788925198.623004:0:5871:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788925198.623018:0:5871:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788925198.623024:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788925198.623064:0:5871:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000daa02c75 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788925198.623074:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f54199c1) 00000020:00000080:2.0:1788925198.623081:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788925198.623140:0:5871:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788925198.623146:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x503aa1a44b68e24b 00000020:00000080:2.0:1788925198.623276:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788925198.623282:0:5871:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788925198.623287:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x503aa1a44b68e252 00080000:01000000:2.0:1788925198.623292:0:5871:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788925198.623295:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x503aa1a44b68e259 00080000:10000000:2.0:1788925198.623916:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788925198.624109:0:5871:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788925198.628238:0:5871:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788925198.750969:0:5871:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788925198.751960:0:5871:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788925198.757491:0:5871:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788925198.757809:0:5871:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788925198.810195:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000021499f1e) 00000020:00000080:2.0:1788925198.810222:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788925198.811853:0:5871:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788925198.811867:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x503aa1a44b68e267 00000020:00000080:2.0:1788925198.812137:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788925198.823111:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788925198.877831:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788925198.924695:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788925199.001287:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788925199.069884:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925199.124608:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788925199.183852:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x503aa1a44b68e26e 00000020:00000080:0.0:1788925199.184547:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788925199.184557:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925199.184563:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925199.184566:0:5871:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788925199.184569:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925199.184575:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925199.184576:0:5871:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788925199.184586:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788925199.184622:0:5871:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788925199.184635:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925199.184638:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925199.184640:0:5871:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788925199.184642:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925199.184644:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925199.184645:0:5871:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788925199.184648:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788925199.184649:0:5871:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788925199.184698:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d07b3128 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5871:1875823947678976:0@lo:502: 00000100:00100000:0.0:1788925199.184781:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925199.184842:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set 000000008bd4e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788925199.184929:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947678976 00000100:00100000:2.0:1788925199.184937:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947678976 00000100:00100000:2.0:1788925199.184986:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788925199.184995:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009aef5a15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:5871:x1875823947678976:12345-0@lo:502: 00000100:00100000:2.0:1788925199.185364:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009aef5a15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:5871:x1875823947678976:12345-0@lo:502: Request processed in 371us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925199.185373:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925199.185576:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d07b3128 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5871:1875823947678976:0@lo:502: 00000020:01000000:1.0:1788925199.185605:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925199.185610:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925199.185611:0:5871:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788925199.185615:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788925199.185771:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788925199.185792:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788925199.185812:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000e6ddb2f3/0x503aa1a44b68e221 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e228 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925199.185822:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000e6ddb2f3/0x503aa1a44b68e221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e228 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925199.185830:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c844c1e800 from 1 10000000:01000000:2.0:1788925199.185832:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788925199.185856:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925199.185869:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925199.185878:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925199.185891:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b71bc51 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679104:0@lo:101: 00000100:00100000:2.0:1788925199.185921:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925199.185990:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fa50a6da going to sleep for 11 seconds 00000100:00100000:0.0:1788925199.186085:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947679104 00000100:00100000:0.0:1788925199.186090:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947679104 00000100:00100000:0.0:1788925199.186155:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788925199.186162:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bbbb1dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:5828:x1875823947679104:12345-0@lo:101: 00010000:00010000:0.0:1788925199.186171:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925199.186183:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e27c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e275 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.186200:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e27c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e275 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.186209:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e27c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e275 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.186216:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a4faa7e0, rc 0) 00000100:00100000:0.0:1788925199.186250:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bbbb1dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+10:5828:x1875823947679104:12345-0@lo:101: Request processed in 90us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925199.186265:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788925199.186328:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b71bc51 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679104:0@lo:101: 00010000:00010000:1.0:1788925199.186339:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e27c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925199.186347:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e27c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925199.186923:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e78b0790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679232:0@lo:256: 00000100:00100000:1.0:1788925199.186974:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925199.187220:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000059077c2d going to sleep for 11 seconds 00000100:00100000:2.0:1788925199.187291:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947679232 00000100:00100000:2.0:1788925199.187297:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947679232 00000100:00100000:2.0:1788925199.187330:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788925199.187337:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015327e2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+10:5828:x1875823947679232:12345-0@lo:256: 20000000:01000000:2.0:1788925199.187351:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788925199.187357:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788925199.187674:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015327e2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+10:5828:x1875823947679232:12345-0@lo:256: Request processed in 338us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925199.187682:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788925199.187760:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e78b0790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679232:0@lo:256: 10000000:01000000:1.0:1788925199.188357:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788925199.188377:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e27c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925199.188395:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e27c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925199.188433:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c844c1e800 from 1 10000000:01000000:1.0:1788925199.188436:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788925199.188463:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925199.188470:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925199.188479:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925199.188496:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e78b0790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679360:0@lo:101: 00000100:00100000:1.0:1788925199.188527:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925199.188601:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000059077c2d going to sleep for 11 seconds 00000100:00100000:0.0:1788925199.188645:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947679360 00000100:00100000:0.0:1788925199.188650:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947679360 00000100:00100000:0.0:1788925199.188689:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788925199.188696:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f335d9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+10:5828:x1875823947679360:12345-0@lo:101: 00010000:00010000:0.0:1788925199.188705:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925199.188718:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000772706f5/0x503aa1a44b68e28a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e283 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.188735:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000772706f5/0x503aa1a44b68e28a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e283 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.188743:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000772706f5/0x503aa1a44b68e28a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e283 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.188750:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000772706f5, rc 0) 00000100:00100000:0.0:1788925199.188869:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f335d9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:5828:x1875823947679360:12345-0@lo:101: Request processed in 173us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925199.188875:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788925199.189027:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e78b0790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679360:0@lo:101: 00010000:00010000:1.0:1788925199.189038:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e28a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925199.189045:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e28a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925199.189099:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e78b0790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679488:0@lo:501: 00000100:00100000:1.0:1788925199.189123:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925199.189179:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000059077c2d going to sleep for 11 seconds 00000100:00100000:3.0:1788925199.189209:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947679488 00000100:00100000:3.0:1788925199.189213:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947679488 00000100:00100000:3.0:1788925199.189276:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788925199.189283:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060591d18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:5828:x1875823947679488:12345-0@lo:501: 00000100:00100000:3.0:1788925199.190050:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060591d18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:5828:x1875823947679488:12345-0@lo:501: Request processed in 767us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925199.190059:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788925199.190139:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e78b0790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679488:0@lo:501: 00000100:00100000:1.0:1788925199.190172:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e78b0790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679616:0@lo:503: 00000100:00100000:1.0:1788925199.190212:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925199.190243:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000059077c2d going to sleep for 11 seconds 00000100:00100000:0.0:1788925199.190289:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947679616 00000100:00100000:0.0:1788925199.190294:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947679616 00000100:00100000:0.0:1788925199.190355:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788925199.190362:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060f42adc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:5828:x1875823947679616:12345-0@lo:503: 00000040:00080000:0.0:1788925199.190397:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788925199.190462:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060f42adc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:5828:x1875823947679616:12345-0@lo:503: Request processed in 100us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925199.190468:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788925199.190529:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925199.190534:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e78b0790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679616:0@lo:503: 00000040:00080000:3.0:1788925199.191331:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788925199.191564:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788925199.191583:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788925199.191606:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e28a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925199.191617:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e28a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925199.191672:0:5828:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788925199.191675:0:5828:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c844c1e800 10000000:01000000:1.0:1788925199.191678:0:5828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c844c1e800 10000000:01000000:1.0:1788925199.191682:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788925199.191686:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c844c1e800 from 1 10000000:01000000:1.0:1788925199.191689:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788925199.191712:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 000000008a8096e6/0x503aa1a44b68e291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925199.191719:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 000000008a8096e6/0x503aa1a44b68e291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925199.191737:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 000000008a8096e6/0x503aa1a44b68e291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925199.191755:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e78b0790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679744:0@lo:101: 00000100:00100000:1.0:1788925199.191797:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925199.191828:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000051ddb19a going to sleep for 11 seconds 00000100:00100000:3.0:1788925199.191842:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947679744 00000100:00100000:3.0:1788925199.191847:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947679744 00000100:00100000:3.0:1788925199.191885:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788925199.191896:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3020b62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:5828:x1875823947679744:12345-0@lo:101: 00010000:00010000:3.0:1788925199.191905:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925199.191915:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d887eec8/0x503aa1a44b68e298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e291 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925199.192133:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d887eec8/0x503aa1a44b68e298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e291 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925199.192143:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d887eec8/0x503aa1a44b68e298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e291 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925199.192151:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d887eec8, rc 0) 00000100:00100000:3.0:1788925199.192187:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3020b62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5828:x1875823947679744:12345-0@lo:101: Request processed in 292us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925199.192193:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788925199.192266:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e78b0790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679744:0@lo:101: 00010000:00010000:1.0:1788925199.192277:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 000000008a8096e6/0x503aa1a44b68e291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e298 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925199.192285:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 000000008a8096e6/0x503aa1a44b68e291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e298 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925199.192324:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e78b0790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679872:0@lo:501: 00000100:00100000:1.0:1788925199.192343:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925199.192358:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000051ddb19a going to sleep for 11 seconds 00000100:00100000:0.0:1788925199.192391:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947679872 00000100:00100000:0.0:1788925199.192417:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947679872 00000100:00100000:0.0:1788925199.192444:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788925199.192450:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000436f38a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5828:x1875823947679872:12345-0@lo:501: 00000100:00100000:0.0:1788925199.192796:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000436f38a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5828:x1875823947679872:12345-0@lo:501: Request processed in 345us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925199.192803:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788925199.192831:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e78b0790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947679872:0@lo:501: 00000100:00100000:2.0:1788925199.192858:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bf62c9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947680000:0@lo:503: 00000100:00100000:2.0:1788925199.192899:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925199.192929:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be2c9e61 going to sleep for 11 seconds 00000100:00100000:1.0:1788925199.192978:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947680000 00000100:00100000:1.0:1788925199.192982:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947680000 00000100:00100000:1.0:1788925199.193024:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788925199.193031:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a826011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5828:x1875823947680000:12345-0@lo:503: 00000100:00100000:2.0:1788925199.193360:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bf62c9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947680000:0@lo:503: 00000100:00100000:1.0:1788925199.193360:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a826011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5828:x1875823947680000:12345-0@lo:503: Request processed in 330us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925199.193367:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788925199.193754:0:5876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c08d438 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5876:1875823947680128:0@lo:502: 00000100:00100000:1.0:1788925199.193788:0:5876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925199.193817:0:5876:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a3c97e89 going to sleep for 11 seconds 00000100:00100000:3.0:1788925199.193838:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947680128 00000100:00100000:3.0:1788925199.193843:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947680128 00000100:00100000:3.0:1788925199.193872:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788925199.193877:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5f3a096 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5876:x1875823947680128:12345-0@lo:502: 00000100:00100000:3.0:1788925199.194279:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5f3a096 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5876:x1875823947680128:12345-0@lo:502: Request processed in 401us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925199.194286:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788925199.194355:0:5876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c08d438 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5876:1875823947680128:0@lo:502: 00000020:01000004:1.0:1788925199.197015:0:5876:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788925199.197097:0:5876:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e831c4a2) 00000020:00000080:1.0:1788925199.197120:0:5876:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788925199.197208:0:5876:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000daa02c75 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788925199.197211:0:5876:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000daa02c75 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788925199.197214:0:5876:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000daa02c75 4 00010000:00080000:1.0:1788925199.197241:0:5876:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002ea54456@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:1.0:1788925199.201515:0:5876:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788925199.201896:0:5876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788925199.201937:0:5876:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788925199.201950:0:5876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x503aa1a44b68e2a6 00000100:00080000:1.0:1788925199.201963:0:5876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788925199.201968:0:5876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002ea54456 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1788925199.202015:0:5876:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003c08d438 x1875823947680256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788925199.202042:0:5876:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788925199.202196:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c08d438 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823947680256:0@lo:38: 00000100:00100000:3.0:1788925199.202283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925199.202506:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947680256 00000100:00100000:1.0:1788925199.202513:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947680256 00000100:00100000:1.0:1788925199.202629:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925199.202637:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c23fab8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875823947680256:12345-0@lo:38: 00000100:00100000:1.0:1788925199.202687:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c23fab8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875823947680256:12345-0@lo:38: Request processed in 50us (405us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788925199.202694:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788925199.202813:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788925199.202821:0:3304:0:(import.c:65:import_set_state_nolock()) 000000002ea54456 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788925199.202825:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788925199.202828:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c08d438 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823947680256:0@lo:38: 00000100:00100000:1.0:1788925199.203695:0:5876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9c15edf pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5876:1875823947680384:0@lo:502: 00000100:00100000:1.0:1788925199.203751:0:5876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925199.203790:0:5876:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b423efe9 going to sleep for 11 seconds 00000100:00100000:0.0:1788925199.203847:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947680384 00000100:00100000:0.0:1788925199.203852:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947680384 00000100:00100000:0.0:1788925199.203890:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788925199.203898:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050632daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5876:x1875823947680384:12345-0@lo:502: 00000100:00100000:0.0:1788925199.204123:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050632daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5876:x1875823947680384:12345-0@lo:502: Request processed in 225us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925199.204131:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788925199.204389:0:5876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9c15edf pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5876:1875823947680384:0@lo:502: 00000040:00080000:1.0:1788925199.204455:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788925199.204653:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788925199.204674:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788925199.204685:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 000000008a8096e6/0x503aa1a44b68e291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e298 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925199.204696:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 000000008a8096e6/0x503aa1a44b68e291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e298 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788925199.204736:0:5828:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788925199.204738:0:5828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788925199.204740:0:5828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925199.204741:0:5828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925199.204742:0:5828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925199.204744:0:5828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925199.204745:0:5828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788925199.204747:0:5828:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788925199.204748:0:5828:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788925199.204752:0:5828:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788925199.204753:0:5828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925199.204755:0:5828:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788925199.204758:0:5828:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788925199.204761:0:5828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788925199.204762:0:5828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788925199.204762:0:5828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925199.204763:0:5828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925199.204764:0:5828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925199.204765:0:5828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925199.204766:0:5828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788925199.204766:0:5828:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788925199.204767:0:5828:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788925199.204768:0:5828:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788925199.204769:0:5828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925199.204769:0:5828:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788925199.204785:0:5828:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788925199.204795:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061efc9da pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947680512:0@lo:253: 00000100:00100000:3.0:1788925199.204831:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925199.204864:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066771245 going to sleep for 11 seconds 00000100:00100000:1.0:1788925199.204951:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947680512 00000100:00100000:1.0:1788925199.204956:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947680512 00000100:00100000:1.0:1788925199.204988:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788925199.204994:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000979f104e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5828:x1875823947680512:12345-0@lo:253: 20000000:01000000:1.0:1788925199.205023:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788925199.205037:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788925199.245611:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788925199.245640:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788925199.245706:0:5863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788925199.245711:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788925199.245730:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.245748:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e27c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e275 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.245756:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.245791:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e27c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e275 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.245805:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e27c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e275 expref: 12 pid: 5840 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925199.245835:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f60f241b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1875823947680640:0@lo:104: 00000100:00100000:0.0:1788925199.245900:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925199.245955:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b51e69d going to sleep for 11 seconds 00000100:00100000:1.0:1788925199.246069:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947680640 00000100:00100000:1.0:1788925199.246079:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947680640 00000100:00100000:1.0:1788925199.246776:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925199.246788:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb231a1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:5863:x1875823947680640:12345-0@lo:104: 00010000:00010000:1.0:1788925199.246801:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e27c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.247117:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788925199.247123:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb231a1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:5863:x1875823947680640:12345-0@lo:104: Request processed in 338us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925199.247133:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788925199.247184:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925199.247190:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e27c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925199.247198:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d1274362 already unused, calling callback (0000000027523d6d) 10000000:00010000:2.0:1788925199.247212:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e27c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925199.247220:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e27c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925199.247227:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e27c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925199.247232:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788925199.247307:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e27c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925199.247314:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788925199.247328:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e27c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925199.247333:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: 00000000d1274362/0x503aa1a44b68e275 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e27c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925199.247338:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f60f241b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1875823947680640:0@lo:104: 00010000:00010000:2.0:1788925199.247347:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925199.247349:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925199.247350:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925199.247357:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925199.247502:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bf62c9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947680768:0@lo:103: 00000100:00100000:3.0:1788925199.247537:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925199.247588:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947680768 00000100:00100000:0.0:1788925199.247593:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947680768 00010000:00010000:0.0:1788925199.247610:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e27c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e275 expref: 13 pid: 5840 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925199.247640:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788925199.247646:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f49a3b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:3306:x1875823947680768:12345-0@lo:103: 00010000:00010000:0.0:1788925199.247656:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925199.247660:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e27c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e275 expref: 13 pid: 5840 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.247669:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e27c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e275 expref: 13 pid: 5840 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.247682:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e27c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e275 expref: 13 pid: 5840 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.247693:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.247699:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788925199.247717:0:5832:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002006313s 00010000:00010000:0.0:1788925199.247720:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.247725:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.247730:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.247735:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.247740:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000095808ef6 already unused, calling callback (000000009f782597) 00010000:00010000:0.0:1788925199.247743:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.247750:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.247769:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925199.247778:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925199.247809:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f49a3b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:3306:x1875823947680768:12345-0@lo:103: Request processed in 164us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925199.247816:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788925199.247831:0:5863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925199.247838:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925199.247840:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bf62c9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947680768:0@lo:103: 00010000:00010000:1.0:1788925199.247844:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000095808ef6/0x503aa1a44b68e2ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925199.257714:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000979f104e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:5828:x1875823947680512:12345-0@lo:253: Request processed in 52712us (52874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925199.257744:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788925199.257917:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061efc9da pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5828:1875823947680512:0@lo:253: 10000000:01000000:3.0:1788925199.257931:0:5828:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788925199.257935:0:5828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788925199.257937:0:5828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788925199.257938:0:5828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925199.257939:0:5828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925199.257940:0:5828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925199.257942:0:5828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925199.257943:0:5828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788925199.257944:0:5828:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788925199.257946:0:5828:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788925199.257947:0:5828:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788925199.257948:0:5828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925199.257950:0:5828:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788925199.257975:0:5828:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788925199.262954:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788925199.263283:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788925199.263869:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788925199.264057:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788925199.264256:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788925199.264691:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788925199.265694:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788925199.266153:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788925199.266717:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788925199.266882:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788925199.267086:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788925199.267249:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788925199.305712:0:5828:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788925199.343561:0:5828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788925199.343904:0:5881:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788925199.343909:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788925199.343965:0:5882:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788925199.346735:0:5828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788925199.346902:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788925199.355379:0:5828:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788925199.355453:0:5828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788925199.356254:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788925199.366238:0:5828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788925199.367004:0:5828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788925199.367051:0:5828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788925199.367625:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788925199.368078:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788925199.372210:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788925199.372481:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788925199.372638:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788925199.372778:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788925199.372942:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788925199.373122:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788925199.373271:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788925199.373437:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788925199.373590:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788925199.374177:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788925199.374350:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788925199.374523:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788925199.374852:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788925199.375034:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788925199.375255:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788925199.375395:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788925199.376325:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788925199.376494:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788925199.376858:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788925199.377029:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788925199.377239:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788925199.377392:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788925199.377557:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788925199.377885:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788925199.379802:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788925199.379988:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788925199.380385:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788925199.380701:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788925199.380847:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788925199.381111:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788925199.381268:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788925199.381727:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788925199.381926:0:5828:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788925199.391901:0:5882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788925199.452465:0:5828:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788925199.452517:0:5828:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae1981d63988 00100000:10000000:0.0:1788925199.452526:0:5828:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788925199.453823:0:5828:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788925199.453839:0:5828:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788925199.453853:0:5828:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788925199.453869:0:5828:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788925199.507110:0:5882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788925199.507191:0:5882:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788925199.507196:0:5882:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788925200.214507:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925201.238677:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925202.262512:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925203.286594:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925204.310561:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788925204.375617:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788925204.375628:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788925204.375631:0:36:0:(import.c:65:import_set_state_nolock()) 000000002ea54456 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788925204.375645:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002ea54456 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1788925204.375673:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a19bd2a9 x1875823947681024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788925204.376003:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043dfe792 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947680896:0@lo:400: 00000100:00100000:3.0:1788925204.376080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925204.376144:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947680896 00000100:00100000:0.0:1788925204.376153:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947680896 00000100:00100000:0.0:1788925204.376198:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788925204.376207:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a910cf19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:3307:x1875823947680896:12345-0@lo:400: 00000100:00100000:2.0:1788925204.376382:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a19bd2a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823947681024:0@lo:38: 00000100:00100000:2.0:1788925204.376451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925204.376513:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947681024 00000100:00100000:2.0:1788925204.376518:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947681024 00000100:00100000:2.0:1788925204.376540:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788925204.376551:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072db5504 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875823947681024:12345-0@lo:38: 00010000:00080000:2.0:1788925204.376575:0:5849:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:2.0:1788925204.376613:0:5849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x503aa1a44b68e2b4 00000004:00100000:2.0:1788925204.376659:0:5849:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788925204.376778:0:5849:0:(import.c:65:import_set_state_nolock()) 000000004871f8c7 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925204.376819:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072db5504 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823947681024:12345-0@lo:38: Request processed in 268us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925204.376826:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788925204.376866:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a19bd2a9 x1875823947681024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788925214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925204.378692:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a910cf19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:3307:x1875823947680896:12345-0@lo:400: Request processed in 2479us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925204.378706:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788925204.379016:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043dfe792 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947680896:0@lo:400: 00000100:00080000:2.0:1788925204.382380:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788925204.382417:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788925204.382423:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788925204.382427:0:3304:0:(import.c:65:import_set_state_nolock()) 000000002ea54456 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788925204.382439:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a19bd2a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823947681024:0@lo:38: 00000001:02000400:2.0:1788925204.930006:0:6125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788925205.334904:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925206.358706:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788925206.934527:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788925206.934541:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c844c1e800 from 3 10000000:01000000:0.0:1788925206.934548:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788925206.934640:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000d8aed893/0x503aa1a44b68e2bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925206.934667:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000d8aed893/0x503aa1a44b68e2bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925206.934680:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000d8aed893/0x503aa1a44b68e2bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925206.934710:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c4377cc7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947681152:0@lo:101: 00000100:00100000:0.0:1788925206.934808:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925206.934889:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 00000000390475fe going to sleep for 11 seconds 00000100:00100000:2.0:1788925206.935577:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947681152 00000100:00100000:2.0:1788925206.935589:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947681152 00000100:00100000:2.0:1788925206.935669:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788925206.935680:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d7a950f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:5844:x1875823947681152:12345-0@lo:101: 00010000:00010000:2.0:1788925206.935699:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925206.935721:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b120cc8/0x503aa1a44b68e2c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e2bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925206.935767:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b120cc8/0x503aa1a44b68e2c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e2bb expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925206.935778:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b120cc8/0x503aa1a44b68e2c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e2bb expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925206.935789:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b120cc8, rc 0) 00000100:00100000:2.0:1788925206.935882:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d7a950f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5844:x1875823947681152:12345-0@lo:101: Request processed in 203us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925206.935890:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788925206.936449:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c4377cc7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947681152:0@lo:101: 00010000:00010000:3.0:1788925206.936474:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000d8aed893/0x503aa1a44b68e2bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e2c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925206.936486:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000d8aed893/0x503aa1a44b68e2bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e2c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925206.936571:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061efc9da pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947681280:0@lo:256: 00000100:00100000:3.0:1788925206.936623:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925206.936670:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e485f4fb going to sleep for 11 seconds 00000100:00100000:0.0:1788925206.937788:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947681280 00000100:00100000:0.0:1788925206.937805:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947681280 00000100:00100000:0.0:1788925206.937877:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788925206.937887:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d78f3e47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5844:x1875823947681280:12345-0@lo:256: 20000000:01000000:0.0:1788925206.937915:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788925206.937933:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788925206.937937:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788925206.938062:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d78f3e47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5844:x1875823947681280:12345-0@lo:256: Request processed in 177us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925206.938070:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788925206.938136:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061efc9da pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947681280:0@lo:256: 10000000:01000000:0.0:1788925206.938201:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788925206.938211:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000d8aed893/0x503aa1a44b68e2bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e2c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925206.938222:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000d8aed893/0x503aa1a44b68e2bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e2c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925207.384065:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925208.407623:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925209.430549:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925209.494649:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e090471d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947681536:0@lo:400: 00000100:00100000:1.0:1788925209.494781:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925209.494882:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947681536 00000100:00100000:1.0:1788925209.494891:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947681536 00000100:00100000:1.0:1788925209.494948:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925209.494955:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085db2eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947681536:12345-0@lo:400: 00000100:00100000:1.0:1788925209.495008:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085db2eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947681536:12345-0@lo:400: Request processed in 54us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925209.495015:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788925209.495457:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e090471d x1875823947681536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925209.495472:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e090471d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947681536:0@lo:400: 00000100:00100000:0.0:1788925209.495597:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925209.495618:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9c15edf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947681408:0@lo:400: 00000100:00100000:0.0:1788925209.495663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925209.495710:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947681408 00000100:00100000:0.0:1788925209.495715:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947681408 00000100:00100000:0.0:1788925209.495751:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788925209.495758:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016ea7542 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:3307:x1875823947681408:12345-0@lo:400: 00000100:00100000:0.0:1788925209.495796:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016ea7542 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:3307:x1875823947681408:12345-0@lo:400: Request processed in 39us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925209.495803:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788925209.495854:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9c15edf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947681408:0@lo:400: 00010000:00010000:2.0:1788925210.454733:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788925210.787474:0:6329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefe194530 20000000:00000080:0.0:1788925210.787492:0:6329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c88073c400 uarg=0000000000000000 20000000:01000000:0.0:1788925210.787523:0:6329:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788925210.787530:0:6329:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788925210.787534:0:6329:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788925210.787889:0:6329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788925210.787900:0:6329:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788925210.791694:0:6329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788925210.791956:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788925210.792014:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788925210.792063:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788925210.792080:0:6329:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788925210.792099:0:6329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925210.792251:0:6329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000772706f5/0x503aa1a44b68e28a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e283 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925210.792269:0:6329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925210.792312:0:6329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000772706f5/0x503aa1a44b68e28a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e283 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925210.792327:0:6329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000772706f5/0x503aa1a44b68e28a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e283 expref: 11 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925210.792342:0:6329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038689a88 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6329:1875823947681664:0@lo:104: 00000100:00100000:0.0:1788925210.793240:0:6329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925210.793354:0:6329:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc66485c going to sleep for 11 seconds 00000100:00100000:2.0:1788925210.795006:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947681664 00000100:00100000:2.0:1788925210.795018:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947681664 00000100:00100000:2.0:1788925210.795195:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788925210.795206:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000176da31d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:6329:x1875823947681664:12345-0@lo:104: 00010000:00010000:2.0:1788925210.795225:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e28a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925210.795373:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788925210.795379:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000176da31d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:6329:x1875823947681664:12345-0@lo:104: Request processed in 176us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925210.795386:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788925210.795453:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925210.795458:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e28a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795466:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000163f537e already unused, calling callback (0000000027523d6d) 10000000:00010000:1.0:1788925210.795470:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e28a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795478:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e28a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925210.795485:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e28a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925210.795490:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788925210.795523:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e28a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795546:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788925210.795564:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e28a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795570:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: 00000000163f537e/0x503aa1a44b68e283 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e28a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795587:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925210.795599:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925210.795601:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925210.795620:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e090471d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947681792:0@lo:103: 00000100:00100000:1.0:1788925210.795658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925210.795702:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947681792 00000100:00100000:1.0:1788925210.795706:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947681792 00010000:00010000:1.0:1788925210.795726:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000772706f5/0x503aa1a44b68e28a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e283 expref: 12 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925210.795747:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925210.795753:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c8efe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:3306:x1875823947681792:12345-0@lo:103: 00010000:00010000:1.0:1788925210.795764:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925210.795767:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000772706f5/0x503aa1a44b68e28a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e283 expref: 12 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795777:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000772706f5/0x503aa1a44b68e28a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e283 expref: 12 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795806:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795823:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795838:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795844:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795850:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795855:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795860:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a4faa7e0 already unused, calling callback (000000009f782597) 00010000:00010000:1.0:1788925210.795863:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795869:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795875:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925210.795884:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925210.795908:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c8efe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:3306:x1875823947681792:12345-0@lo:103: Request processed in 156us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925210.795914:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925210.795947:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e090471d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947681792:0@lo:103: 00010000:00010000:0.0:1788925210.796256:0:6329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000772706f5/0x503aa1a44b68e28a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e283 expref: 11 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925210.796269:0:6329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038689a88 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6329:1875823947681664:0@lo:104: 00010000:00010000:0.0:1788925210.796282:0:6329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925210.796289:0:6329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925210.796295:0:6329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925210.796300:0:6329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a4faa7e0/0x503aa1a44b68e2c9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925211.487348:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925212.504428:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925213.532086:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925214.550769:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925214.614689:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e59dae1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947682048:0@lo:400: 00000100:00100000:1.0:1788925214.614778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925214.614849:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925214.614855:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065162256 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947681920:0@lo:400: 00000100:00100000:1.0:1788925214.614881:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925214.614961:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947682048 00000100:00100000:3.0:1788925214.614971:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947682048 00000100:00100000:3.0:1788925214.615023:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925214.615030:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e090471d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947682048:12345-0@lo:400: 00000100:00100000:3.0:1788925214.615092:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e090471d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947682048:12345-0@lo:400: Request processed in 62us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925214.615107:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788925214.615145:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e59dae1d x1875823947682048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925214.615159:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e59dae1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947682048:0@lo:400: 00000100:00100000:3.0:1788925214.615691:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947681920 00000100:00100000:3.0:1788925214.615697:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947681920 00000100:00100000:3.0:1788925214.615740:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788925214.615746:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f4b9d07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:3308:x1875823947681920:12345-0@lo:400: 00000100:00100000:3.0:1788925214.615784:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f4b9d07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:3308:x1875823947681920:12345-0@lo:400: Request processed in 39us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925214.615790:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788925214.615820:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065162256 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947681920:0@lo:400: 00010000:00010000:3.0:1788925215.574576:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788925215.639529:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788925215.639538:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c844c1e800 from 1 10000000:01000000:1.0:1788925215.639544:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788925215.639587:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000ca50ede8/0x503aa1a44b68e2d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925215.639723:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000ca50ede8/0x503aa1a44b68e2d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925215.639737:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000ca50ede8/0x503aa1a44b68e2d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925215.639772:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edb33f9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947682176:0@lo:101: 00000100:00100000:1.0:1788925215.639844:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925215.639900:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e9b46f41 going to sleep for 11 seconds 00000100:00100000:2.0:1788925215.639951:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947682176 00000100:00100000:2.0:1788925215.639959:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947682176 00000100:00100000:2.0:1788925215.640013:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788925215.640044:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3277aba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:5844:x1875823947682176:12345-0@lo:101: 00010000:00010000:2.0:1788925215.640058:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925215.640072:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005620d1fd/0x503aa1a44b68e2d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e2d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925215.640092:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005620d1fd/0x503aa1a44b68e2d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e2d0 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925215.640101:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005620d1fd/0x503aa1a44b68e2d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e2d0 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925215.640110:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005620d1fd, rc 0) 00000100:00100000:2.0:1788925215.640157:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3277aba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5844:x1875823947682176:12345-0@lo:101: Request processed in 115us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925215.640164:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788925215.640349:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edb33f9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947682176:0@lo:101: 00010000:00010000:1.0:1788925215.640363:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000ca50ede8/0x503aa1a44b68e2d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e2d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925215.640371:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000ca50ede8/0x503aa1a44b68e2d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e2d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925215.640457:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edb33f9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947682304:0@lo:501: 00000100:00100000:1.0:1788925215.640482:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925215.640501:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e9b46f41 going to sleep for 11 seconds 00000100:00100000:2.0:1788925215.640622:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947682304 00000100:00100000:2.0:1788925215.640756:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947682304 00000100:00100000:2.0:1788925215.640786:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788925215.640791:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f7c48d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5844:x1875823947682304:12345-0@lo:501: 00000100:00100000:2.0:1788925215.641240:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f7c48d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5844:x1875823947682304:12345-0@lo:501: Request processed in 447us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925215.641248:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788925215.641323:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edb33f9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947682304:0@lo:501: 00000100:00100000:1.0:1788925215.641357:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edb33f9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947682432:0@lo:503: 00000100:00100000:1.0:1788925215.641394:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925215.641445:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e9b46f41 going to sleep for 11 seconds 00000100:00100000:2.0:1788925215.641494:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947682432 00000100:00100000:2.0:1788925215.641499:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947682432 00000100:00100000:2.0:1788925215.641533:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788925215.641539:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c85fb2f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5844:x1875823947682432:12345-0@lo:503: 00000100:00100000:2.0:1788925215.641901:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c85fb2f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5844:x1875823947682432:12345-0@lo:503: Request processed in 361us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925215.641916:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788925215.641989:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edb33f9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947682432:0@lo:503: 00000100:00100000:3.0:1788925215.642439:0:6613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065162256 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6613:1875823947682560:0@lo:502: 00000100:00100000:3.0:1788925215.642479:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925215.642498:0:6613:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edebdb25 going to sleep for 11 seconds 00000100:00100000:2.0:1788925215.642670:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947682560 00000100:00100000:2.0:1788925215.642676:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947682560 00000100:00100000:2.0:1788925215.642745:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788925215.642760:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000547a0d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6613:x1875823947682560:12345-0@lo:502: 00000100:00100000:2.0:1788925215.642913:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000547a0d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6613:x1875823947682560:12345-0@lo:502: Request processed in 162us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925215.642920:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788925215.642993:0:6613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065162256 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6613:1875823947682560:0@lo:502: 00000020:01000000:3.0:1788925215.643034:0:6613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925215.643044:0:6613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925215.643046:0:6613:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788925215.643053:0:6613:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c844c1e800 00000020:00000080:3.0:1788925215.643056:0:6613:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788925215.643096:0:6613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6613:1875823947682688:0@lo:502: 00000100:00100000:3.0:1788925215.643128:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925215.645635:0:6613:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847847540 going to sleep for 11 seconds 00000100:00100000:2.0:1788925215.645747:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947682688 00000100:00100000:2.0:1788925215.645823:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947682688 00000100:00100000:2.0:1788925215.645872:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788925215.645882:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6613:x1875823947682688:12345-0@lo:502: 00000100:00100000:2.0:1788925215.646306:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6613:x1875823947682688:12345-0@lo:502: Request processed in 424us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925215.646314:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788925215.646976:0:6613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6613:1875823947682688:0@lo:502: 00000020:01000000:3.0:1788925215.647184:0:6613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925215.647192:0:6613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925215.647194:0:6613:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788925215.647199:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788925215.647371:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788925215.647396:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788925215.647481:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c861867e00/0x503aa1a44b68e2d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e2d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925215.647493:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c861867e00/0x503aa1a44b68e2d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e2d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925216.601180:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925217.623008:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788925218.104533:0:6696:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788925218.104537:0:6696:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788925218.104680:0:6696:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c87599a800 00000020:01000004:1.0:1788925218.104698:0:6696:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788925218.104710:0:6696:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788925218.104724:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98c851543370) 00000020:00000080:1.0:1788925218.104740:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788925218.124726:0:6696:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788925218.125143:0:6696:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788925218.150118:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788925218.157763:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788925218.157793:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788925218.157843:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788925218.157865:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788925218.158180:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788925218.158191:0:6696:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788925218.158202:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x503aa1a44b68e2e5 00000020:01000004:3.0:1788925218.158211:0:6696:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788925218.158232:0:6696:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.128@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788925218.158235:0:6696:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788925218.158240:0:6696:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788925218.158245:0:6696:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788925218.158261:0:6696:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98c874f0b370) 00000020:00000080:3.0:1788925218.158271:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788925218.159314:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788925218.159511:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788925218.159518:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788925218.167029:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788925218.167045:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788925218.167221:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788925218.167230:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788925218.171093:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788925218.171285:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788925218.171292:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788925218.172139:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788925218.172147:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788925218.200312:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788925218.200836:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788925218.200843:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788925218.203670:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788925218.203687:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788925218.205348:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788925218.205362:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788925218.208102:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925218.208380:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788925218.208386:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788925218.209078:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788925218.209086:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788925218.328337:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788925218.328833:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788925218.328840:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788925218.333185:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788925218.336722:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788925218.343149:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788925218.343180:0:6696:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788925218.343186:0:6696:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788925218.409952:0:6696:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788925218.409991:0:6696:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.128@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788925218.409996:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788925218.409997:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788925218.409998:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925218.409999:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925218.410000:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925218.410002:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925218.410004:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788925218.410005:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788925218.410006:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788925218.410007:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925218.410009:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788925218.410012:0:6696:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788925218.410014:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788925218.410015:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788925218.410017:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925218.410018:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925218.410019:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925218.410020:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925218.410021:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788925218.410022:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788925218.410023:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788925218.410024:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925218.410026:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788925218.410057:0:6696:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788925218.410078:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947682816:0@lo:253: 00000100:00100000:0.0:1788925218.410157:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.410239:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c858327480 going to sleep for 11 seconds 00000100:00100000:2.0:1788925218.410451:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947682816 00000100:00100000:2.0:1788925218.410460:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947682816 00000100:00100000:2.0:1788925218.410514:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788925218.410524:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6696:x1875823947682816:12345-0@lo:253: 20000000:01000000:2.0:1788925218.410571:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788925218.410576:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788925218.410581:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788925218.410585:0:5840:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788925218.411493:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788925218.411722:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788925218.411736:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788925218.411776:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788925218.411784:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788925218.411814:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788925218.411876:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788925218.412255:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788925218.412277:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.128@tcp 20000000:01000000:2.0:1788925218.412279:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:2.0:1788925218.412313:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788925218.412321:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788925218.412380:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788925218.412389:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:2.0:1788925218.412456:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788925218.412466:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788925218.412495:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788925218.412541:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788925218.418313:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788925218.418566:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.128@tcp 20000000:01000000:3.0:1788925218.418572:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:3.0:1788925218.418637:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788925218.418647:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788925218.418690:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788925218.418714:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:3.0:1788925218.418764:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788925218.418775:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788925218.418807:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788925218.418843:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788925218.418866:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788925218.418870:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788925218.418874:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788925218.418902:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788925218.418905:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788925218.418959:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788925218.418963:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788925218.425796:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788925218.425891:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788925218.425954:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788925218.427307:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788925218.428187:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788925218.428250:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788925218.428268:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788925218.428271:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788925218.433471:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788925218.433907:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788925218.433955:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788925218.434071:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788925218.434085:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788925218.434089:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788925218.435176:0:6714:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788925218.435237:0:6714:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788925218.435281:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788925218.435775:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788925218.435814:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788925218.435872:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788925218.435889:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788925218.435891:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788925218.435901:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788925218.435920:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.436070:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e20c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e205 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.436078:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c85c218c00/0x503aa1a44b68e228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e221 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.436085:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c8821c7000/0x503aa1a44b68e298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e291 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.436092:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.436150:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c8821c7000/0x503aa1a44b68e298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e291 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.436167:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c8821c7000/0x503aa1a44b68e298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e291 expref: 12 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925218.436182:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875823947682944:0@lo:104: 00000100:00100000:1.0:1788925218.436254:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788925218.436371:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c85c218c00/0x503aa1a44b68e228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e221 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.436380:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c85c218c00/0x503aa1a44b68e228 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e221 expref: 12 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925218.436388:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875823947683072:0@lo:104: 00000100:00100000:1.0:1788925218.436523:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925218.441092:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947682944 00000100:00100000:2.0:1788925218.441113:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947682944 00010000:00010000:0.0:1788925218.441339:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e20c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e205 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.441356:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e20c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e205 expref: 12 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925218.441372:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875823947683200:0@lo:104: 00000100:00100000:0.0:1788925218.441472:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.449780:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c874e0fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788925218.453738:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947683072 00000100:00100000:3.0:1788925218.453754:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947683072 00000100:00100000:3.0:1788925218.453809:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947683200 00000100:00100000:3.0:1788925218.453812:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947683200 00000100:00100000:3.0:1788925218.453832:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788925218.453843:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+5:5840:x1875823947682944:12345-0@lo:104: 00010000:00010000:3.0:1788925218.453862:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c861867200/0x503aa1a44b68e291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e298 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.454094:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788925218.454101:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+5:5840:x1875823947682944:12345-0@lo:104: Request processed in 259us (17847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925218.454109:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788925218.454131:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925218.454137:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+4:5840:x1875823947683072:12345-0@lo:104: 00010000:00010000:3.0:1788925218.454146:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e228 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.454181:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788925218.454187:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+4:5840:x1875823947683072:12345-0@lo:104: Request processed in 51us (17664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925218.454193:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925218.454205:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788925218.454211:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:5840:x1875823947683200:12345-0@lo:104: 00010000:00010000:3.0:1788925218.454218:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e20c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.454245:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788925218.454250:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:5840:x1875823947683200:12345-0@lo:104: Request processed in 40us (12780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925218.454256:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788925218.454272:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788925218.454279:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c861867200/0x503aa1a44b68e291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e298 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.454286:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861867200 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925218.454296:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c861867200/0x503aa1a44b68e291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e298 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.454306:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c861867200/0x503aa1a44b68e291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e298 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925218.454314:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c861867200/0x503aa1a44b68e291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e298 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925218.454319:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925218.454359:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c861867200/0x503aa1a44b68e291 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e298 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.454366:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925218.454386:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c861867200/0x503aa1a44b68e291 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e298 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.454394:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c861867200/0x503aa1a44b68e291 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e298 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.455077:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788925218.455082:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e228 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.455090:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c85c218600 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925218.455094:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e228 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.455102:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e228 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925218.455119:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e228 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925218.455125:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925218.455143:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e228 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.455148:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925218.455156:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e221 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e228 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.455163:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e228 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.455172:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925218.455176:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e20c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.455182:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c85c219200 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925218.455185:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e20c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.455191:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e20c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925218.455197:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e20c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925218.455203:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925218.455220:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e20c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.455226:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925218.455243:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e205 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e20c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.455250:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e20c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.455265:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925218.455266:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925218.455268:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925218.455276:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925218.455298:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947683328:0@lo:103: 00000100:00100000:3.0:1788925218.455346:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925218.455394:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925218.455535:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947683456:0@lo:103: 00000100:00100000:0.0:1788925218.455604:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875823947682944:0@lo:104: 00000100:00100000:0.0:1788925218.455615:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875823947683072:0@lo:104: 00000100:00100000:0.0:1788925218.455624:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875823947683200:0@lo:104: 00010000:00010000:0.0:1788925218.455648:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925218.456734:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947683328 00000100:00100000:0.0:1788925218.456745:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947683328 00010000:00010000:0.0:1788925218.456784:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c8821c7000/0x503aa1a44b68e298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e291 expref: 13 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925218.456825:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788925218.456834:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:3305:x1875823947683328:12345-0@lo:103: 00010000:00010000:0.0:1788925218.456847:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925218.456852:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c8821c7000/0x503aa1a44b68e298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e291 expref: 13 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.456867:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c8821c7000/0x503aa1a44b68e298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e291 expref: 13 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.456901:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c8821c7000/0x503aa1a44b68e298 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e291 expref: 13 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.456919:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925218.456971:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:3305:x1875823947683328:12345-0@lo:103: Request processed in 138us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925218.456991:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925218.458729:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947683584:0@lo:103: 00000100:00100000:1.0:1788925218.458801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925218.458939:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947683584 00000100:00100000:2.0:1788925218.458947:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947683584 00010000:00010000:2.0:1788925218.459174:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e20c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e205 expref: 12 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925218.459248:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788925218.459271:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:3307:x1875823947683584:12345-0@lo:103: 00010000:00010000:2.0:1788925218.459285:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925218.459291:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e20c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e205 expref: 12 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.459303:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e20c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e205 expref: 12 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.459319:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e20c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e205 expref: 12 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.459335:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788925218.459386:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:3307:x1875823947683584:12345-0@lo:103: Request processed in 117us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925218.459393:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788925218.459523:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947683584:0@lo:103: 00000100:00100000:3.0:1788925218.460449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925218.461177:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947683328:0@lo:103: 00000100:00100000:0.0:1788925218.461297:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947683456 00000100:00100000:0.0:1788925218.461305:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947683456 00010000:00010000:0.0:1788925218.461338:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c85c218c00/0x503aa1a44b68e228 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e221 expref: 11 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925218.461373:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788925218.461381:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:3305:x1875823947683456:12345-0@lo:103: 00010000:00010000:0.0:1788925218.461395:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925218.461435:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c85c218c00/0x503aa1a44b68e228 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e221 expref: 11 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.461451:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c85c218c00/0x503aa1a44b68e228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e221 expref: 11 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.461467:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c85c218c00/0x503aa1a44b68e228 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e221 expref: 11 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.461482:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.461491:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.461526:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.461534:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.461541:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.461549:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.461555:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861866800 already unused, calling callback (ffffffffc15c6230) 00010000:00010000:0.0:1788925218.461560:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.461568:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.461586:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.461597:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925218.461641:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+10:3305:x1875823947683456:12345-0@lo:103: Request processed in 261us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925218.461648:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788925218.461847:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947683456:0@lo:103: 00010000:00010000:3.0:1788925218.461868:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.461876:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.461882:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c861866800/0x503aa1a44b68e2f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788925218.461905:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788925218.511222:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:6696:x1875823947682816:12345-0@lo:253: Request processed in 100690us (101055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925218.511237:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788925218.511818:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947682816:0@lo:253: 10000000:01000000:0.0:1788925218.511836:0:6696:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788925218.511839:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788925218.511857:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788925218.511859:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925218.511860:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788925218.511861:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925218.511863:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925218.511864:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788925218.511866:0:6696:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788925218.511868:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925218.511869:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788925218.511889:0:6696:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98c87599a800 from lustre-OST0000 10000000:01000000:0.0:1788925218.511915:0:6696:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788925218.511918:0:6696:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788925218.511926:0:6696:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98c844a44d28 local copy 10000000:01000000:0.0:1788925218.511942:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788925218.511991:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.512002:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.512012:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925218.512190:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947683712:0@lo:101: 00000100:00100000:0.0:1788925218.512238:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.512296:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c858327480 going to sleep for 11 seconds 00000100:00100000:1.0:1788925218.512361:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947683712 00000100:00100000:1.0:1788925218.512369:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947683712 00000100:00100000:1.0:1788925218.512442:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788925218.512452:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:6696:x1875823947683712:12345-0@lo:101: 00010000:00010000:1.0:1788925218.512468:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925218.512489:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c861867400/0x503aa1a44b68e301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e2fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.512513:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c861867400/0x503aa1a44b68e301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e2fa expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.512524:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c861867400/0x503aa1a44b68e301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e2fa expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.512533:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c861867400, rc 0) 00000100:00100000:1.0:1788925218.512567:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+10:6696:x1875823947683712:12345-0@lo:101: Request processed in 116us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925218.512574:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788925218.512669:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947683712:0@lo:101: 00010000:00010000:3.0:1788925218.512682:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x503aa1a44b68e301 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.512691:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x503aa1a44b68e301 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925218.512788:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947683840:0@lo:501: 00000100:00100000:3.0:1788925218.512815:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925218.512843:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c868a40e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788925218.512902:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947683840 00000100:00100000:0.0:1788925218.512907:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947683840 00000100:00100000:0.0:1788925218.513133:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788925218.513142:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+10:6696:x1875823947683840:12345-0@lo:501: 00000100:00100000:0.0:1788925218.513354:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+10:6696:x1875823947683840:12345-0@lo:501: Request processed in 213us (537us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788925218.513362:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788925218.513456:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947683840:0@lo:501: 10000000:01000000:3.0:1788925218.513471:0:6696:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788925218.513499:0:6696:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788925218.513505:0:6696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x503aa1a44b68e301 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.513514:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x503aa1a44b68e301 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.513520:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x503aa1a44b68e301 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.513545:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788925218.513562:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98c87599a800 10000000:01000000:3.0:1788925218.513567:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788925218.513572:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98c844a44d28 10000000:01000000:3.0:1788925218.513580:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788925218.513583:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98c844a44d28 from 1 10000000:01000000:3.0:1788925218.513586:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788925218.513606:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c8821c7200/0x503aa1a44b68e308 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.513614:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c8821c7200/0x503aa1a44b68e308 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.513623:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c8821c7200/0x503aa1a44b68e308 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925218.513637:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947683968:0@lo:101: 00010000:00010000:0.0:1788925218.513759:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925218.513765:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x503aa1a44b68e301 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.513773:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c840031600 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:0.0:1788925218.513778:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x503aa1a44b68e301 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.513787:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x503aa1a44b68e301 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925218.513796:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x503aa1a44b68e301 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925218.513802:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925218.513821:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x503aa1a44b68e301 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.513827:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925218.513848:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x503aa1a44b68e301 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.513855:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c840031600/0x503aa1a44b68e2fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x503aa1a44b68e301 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.513872:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925218.513874:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925218.513875:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925218.513886:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947684096:0@lo:103: 00000100:00100000:0.0:1788925218.513916:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925218.514144:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925218.514169:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c868a40c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788925218.517247:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947683968 00000100:00100000:1.0:1788925218.517265:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947683968 00000100:00100000:0.0:1788925218.517275:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947684096 00000100:00100000:0.0:1788925218.517293:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947684096 00000100:00100000:1.0:1788925218.517321:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788925218.517323:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788925218.517331:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:3308:x1875823947684096:12345-0@lo:103: 00010000:00010000:0.0:1788925218.517347:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925218.517367:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c861867400/0x503aa1a44b68e301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x503aa1a44b68e2fa expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.517390:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925218.517495:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+10:3308:x1875823947684096:12345-0@lo:103: Request processed in 165us (3577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925218.517503:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788925218.517542:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947684096:0@lo:103: 00000100:00100000:1.0:1788925218.517641:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:6696:x1875823947683968:12345-0@lo:101: 00010000:00010000:1.0:1788925218.517667:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925218.517683:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c861866400/0x503aa1a44b68e30f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e308 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.517703:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c861866400/0x503aa1a44b68e30f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e308 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.517713:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c861866400/0x503aa1a44b68e30f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e308 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.517721:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c861866400, rc 0) 00000100:00100000:1.0:1788925218.517765:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+10:6696:x1875823947683968:12345-0@lo:101: Request processed in 435us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925218.517781:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788925218.517897:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947683968:0@lo:101: 00010000:00010000:0.0:1788925218.517912:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c8821c7200/0x503aa1a44b68e308 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e30f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.517922:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c8821c7200/0x503aa1a44b68e308 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e30f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925218.518881:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788925218.518898:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c8821c7200/0x503aa1a44b68e308 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e30f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.518906:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c8821c7200/0x503aa1a44b68e308 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e30f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925218.518913:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788925218.518920:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788925218.519142:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788925218.519145:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788925218.519180:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.519188:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.519198:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925218.519220:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684224:0@lo:101: 00000100:00100000:0.0:1788925218.519276:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.519308:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c858327480 going to sleep for 11 seconds 00000100:00100000:1.0:1788925218.519564:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947684224 00000100:00100000:1.0:1788925218.519571:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947684224 00000100:00100000:1.0:1788925218.519646:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788925218.519663:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+10:6696:x1875823947684224:12345-0@lo:101: 00010000:00010000:1.0:1788925218.519675:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925218.519687:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c861866600/0x503aa1a44b68e31d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e316 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.519704:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c861866600/0x503aa1a44b68e31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e316 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.519713:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c861866600/0x503aa1a44b68e31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e316 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.519720:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c861866600, rc 0) 00000100:00100000:1.0:1788925218.519759:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:6696:x1875823947684224:12345-0@lo:101: Request processed in 97us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925218.519764:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788925218.519829:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684224:0@lo:101: 00010000:00010000:0.0:1788925218.519842:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e31d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.519851:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e31d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925218.520789:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684352:0@lo:501: 00000100:00100000:0.0:1788925218.520840:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925218.522720:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947684352 00000100:00100000:3.0:1788925218.522733:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947684352 00000100:00100000:3.0:1788925218.522782:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788925218.522791:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:6696:x1875823947684352:12345-0@lo:501: 00000100:00100000:3.0:1788925218.523123:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:6696:x1875823947684352:12345-0@lo:501: Request processed in 332us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925218.523131:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788925218.523789:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c858327480 going to sleep for 11 seconds 00000100:00100000:0.0:1788925218.523942:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684352:0@lo:501: 00000100:00100000:0.0:1788925218.524212:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684480:0@lo:503: 00000100:00100000:0.0:1788925218.524273:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.524341:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c858327480 going to sleep for 11 seconds 00000100:00100000:3.0:1788925218.524457:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947684480 00000100:00100000:3.0:1788925218.524464:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947684480 00000100:00100000:3.0:1788925218.524508:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788925218.524515:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:6696:x1875823947684480:12345-0@lo:503: 00000100:00100000:3.0:1788925218.524955:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:6696:x1875823947684480:12345-0@lo:503: Request processed in 439us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925218.524963:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788925218.525165:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684480:0@lo:503: 00000040:00080000:0.0:1788925218.525722:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788925218.525868:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684608:0@lo:502: 00000100:00100000:0.0:1788925218.525924:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.525961:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c84578bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925218.526101:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947684608 00000100:00100000:2.0:1788925218.526110:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947684608 00000100:00100000:2.0:1788925218.526227:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788925218.526236:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:6696:x1875823947684608:12345-0@lo:502: 00000100:00100000:2.0:1788925218.526451:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:6696:x1875823947684608:12345-0@lo:502: Request processed in 216us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925218.526458:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788925218.526557:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684608:0@lo:502: 00000040:00080000:0.0:1788925218.526849:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788925218.526901:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788925218.526937:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788925218.527004:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788925218.527043:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788925218.527079:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788925218.527111:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684736:0@lo:502: 00000100:00100000:0.0:1788925218.527152:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.528250:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c858327480 going to sleep for 11 seconds 00000100:00100000:1.0:1788925218.528322:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947684736 00000100:00100000:1.0:1788925218.528329:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947684736 00000100:00100000:1.0:1788925218.528462:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788925218.528472:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:6696:x1875823947684736:12345-0@lo:502: 00000100:00100000:1.0:1788925218.528682:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:6696:x1875823947684736:12345-0@lo:502: Request processed in 211us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925218.528689:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788925218.528809:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684736:0@lo:502: 00000040:00080000:0.0:1788925218.528930:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788925218.528943:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788925218.529744:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788925218.529753:0:6716:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788925218.529759:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925218.529761:0:6716:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788925218.529767:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788925218.529782:0:6716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98c844a40000) 00000020:00000080:0.0:1788925218.529817:0:6716:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788925218.529824:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788925218.529906:0:6716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c87599a800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788925218.529913:0:6716:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788925218.529919:0:6716:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x503aa1a44b68e32b 00010000:00010000:1.0:1788925218.538286:0:6716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788925218.538740:0:6716:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788925218.545451:0:6716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788925218.545859:0:6716:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788925218.576454:0:6716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788925218.576998:0:6716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788925218.588467:0:6716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788925218.588480:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925218.588487:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925218.588489:0:6716:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788925218.588493:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925218.588497:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925218.588498:0:6716:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788925218.588500:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788925218.588502:0:6716:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788925218.588560:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925218.588562:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925218.588563:0:6716:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788925218.588566:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788925218.588915:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788925218.588938:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788925218.588964:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e31d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.588978:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e31d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925218.588988:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c87599a800 from 1 10000000:01000000:1.0:1788925218.588990:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788925218.589032:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.589042:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.589054:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925218.589076:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684864:0@lo:101: 00000100:00100000:1.0:1788925218.589148:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925218.589203:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788925218.589314:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947684864 00000100:00100000:0.0:1788925218.589321:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947684864 00000100:00100000:0.0:1788925218.589382:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788925218.589392:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:6696:x1875823947684864:12345-0@lo:101: 00010000:00010000:0.0:1788925218.589433:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925218.589448:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c840031600/0x503aa1a44b68e339 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e332 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.589473:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c840031600/0x503aa1a44b68e339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e332 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.589483:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c840031600/0x503aa1a44b68e339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e332 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925218.589493:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c840031600, rc 0) 00000100:00100000:0.0:1788925218.589531:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6696:x1875823947684864:12345-0@lo:101: Request processed in 140us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925218.589547:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788925218.589731:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684864:0@lo:101: 00010000:00010000:1.0:1788925218.589746:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e339 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.589755:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e339 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925218.589868:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684992:0@lo:501: 00000100:00100000:1.0:1788925218.589894:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925218.589922:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788925218.590015:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947684992 00000100:00100000:3.0:1788925218.590020:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947684992 00000100:00100000:3.0:1788925218.590049:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788925218.590056:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6696:x1875823947684992:12345-0@lo:501: 00000100:00100000:3.0:1788925218.590279:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6696:x1875823947684992:12345-0@lo:501: Request processed in 222us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925218.590285:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788925218.590917:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947684992:0@lo:501: 00000100:00100000:1.0:1788925218.590952:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685120:0@lo:503: 00000100:00100000:1.0:1788925218.590998:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925218.591029:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788925218.591096:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947685120 00000100:00100000:3.0:1788925218.591102:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947685120 00000100:00100000:3.0:1788925218.591136:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788925218.591144:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6696:x1875823947685120:12345-0@lo:503: 00000100:00100000:3.0:1788925218.591331:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6696:x1875823947685120:12345-0@lo:503: Request processed in 187us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925218.591338:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788925218.592043:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685120:0@lo:503: 00000040:00080000:0.0:1788925218.592592:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788925218.592670:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685248:0@lo:502: 00000100:00100000:0.0:1788925218.592725:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.592755:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8759c8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788925218.592787:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947685248 00000100:00100000:0.0:1788925218.592792:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947685248 00000100:00100000:0.0:1788925218.593261:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788925218.593270:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6696:x1875823947685248:12345-0@lo:502: 00000100:00100000:0.0:1788925218.593486:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6696:x1875823947685248:12345-0@lo:502: Request processed in 216us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925218.593494:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788925218.596010:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685248:0@lo:502: 00000040:00080000:0.0:1788925218.597079:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788925218.597160:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788925218.597207:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685376:0@lo:502: 00000100:00100000:0.0:1788925218.597297:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.597335:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8759c8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788925218.597460:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947685376 00000100:00100000:1.0:1788925218.597468:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947685376 00000100:00100000:1.0:1788925218.597516:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788925218.597525:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6696:x1875823947685376:12345-0@lo:502: 00000100:00100000:1.0:1788925218.597747:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6696:x1875823947685376:12345-0@lo:502: Request processed in 222us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925218.597755:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788925218.598533:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685376:0@lo:502: 00000040:00080000:0.0:1788925218.598679:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788925218.598693:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788925218.602961:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925218.602977:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925218.602980:0:6720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788925218.602988:0:6720:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c87599a800 00000020:00000080:1.0:1788925218.602991:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788925218.603012:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925218.603016:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925218.603017:0:6720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788925218.603020:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788925218.603167:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788925218.603193:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788925218.603219:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e339 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.603233:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e339 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925218.603287:0:6696:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788925218.603291:0:6696:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c87599a800 10000000:01000000:2.0:1788925218.603294:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c87599a800 10000000:01000000:2.0:1788925218.603298:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788925218.603303:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c87599a800 from 1 10000000:01000000:2.0:1788925218.603306:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788925218.603341:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.603351:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.603371:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925218.603394:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685504:0@lo:101: 00000100:00100000:2.0:1788925218.603496:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925218.603534:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c850f76cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925218.603733:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947685504 00000100:00100000:1.0:1788925218.603741:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947685504 00000100:00100000:1.0:1788925218.603800:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788925218.603811:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6696:x1875823947685504:12345-0@lo:101: 00010000:00010000:1.0:1788925218.603832:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925218.603846:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e340 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.603870:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e340 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.603881:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e340 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.603890:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c861867c00, rc 0) 00000100:00100000:1.0:1788925218.603931:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6696:x1875823947685504:12345-0@lo:101: Request processed in 121us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925218.603938:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788925218.604111:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685504:0@lo:101: 00010000:00010000:2.0:1788925218.604125:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e347 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.604134:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e347 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925218.604221:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685632:0@lo:501: 00000100:00100000:2.0:1788925218.604246:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925218.604275:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c850f76cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925218.604489:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947685632 00000100:00100000:2.0:1788925218.604494:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947685632 00000100:00100000:2.0:1788925218.604527:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788925218.604534:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6696:x1875823947685632:12345-0@lo:501: 00000100:00100000:2.0:1788925218.604779:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6696:x1875823947685632:12345-0@lo:501: Request processed in 244us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925218.604787:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788925218.604833:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685632:0@lo:501: 00000100:00100000:2.0:1788925218.604861:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685760:0@lo:503: 00000100:00100000:2.0:1788925218.604898:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925218.604913:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c850f76cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925218.604926:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947685760 00000100:00100000:2.0:1788925218.604929:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947685760 00000100:00100000:2.0:1788925218.604951:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788925218.604957:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6696:x1875823947685760:12345-0@lo:503: 00000100:00100000:2.0:1788925218.605091:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6696:x1875823947685760:12345-0@lo:503: Request processed in 132us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925218.605097:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788925218.605137:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685760:0@lo:503: 00000040:00080000:2.0:1788925218.605459:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788925218.605508:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685888:0@lo:502: 00000100:00100000:2.0:1788925218.605542:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925218.605558:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c850f76cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925218.605572:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947685888 00000100:00100000:2.0:1788925218.605576:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947685888 00000100:00100000:2.0:1788925218.605597:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788925218.605609:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6696:x1875823947685888:12345-0@lo:502: 00000100:00100000:2.0:1788925218.605777:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6696:x1875823947685888:12345-0@lo:502: Request processed in 167us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925218.605784:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788925218.605825:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947685888:0@lo:502: 00000040:00080000:2.0:1788925218.606075:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788925218.606123:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788925218.606157:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788925218.606202:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788925218.606236:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788925218.606282:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788925218.606318:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788925218.606352:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788925218.606420:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788925218.606460:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788925218.606493:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788925218.606542:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788925218.606592:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788925218.606627:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788925218.606681:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788925218.606712:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788925218.606737:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788925218.606793:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788925218.606831:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788925218.606861:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788925218.606905:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788925218.606941:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788925218.606975:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788925218.607023:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788925218.607060:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788925218.607092:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788925218.607155:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788925218.607192:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788925218.607236:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947686016:0@lo:502: 00000100:00100000:2.0:1788925218.607299:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925218.608330:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c850f76cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925218.608599:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947686016 00000100:00100000:0.0:1788925218.608609:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947686016 00000100:00100000:0.0:1788925218.608669:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788925218.608678:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6696:x1875823947686016:12345-0@lo:502: 00000100:00100000:0.0:1788925218.609039:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6696:x1875823947686016:12345-0@lo:502: Request processed in 361us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925218.609047:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788925218.609134:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947686016:0@lo:502: 00000040:00080000:2.0:1788925218.609250:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788925218.609265:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788925218.609821:0:6721:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788925218.609848:0:6721:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98c87ff999b8) 00000020:00000080:2.0:1788925218.609870:0:6721:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788925218.609955:0:6721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c87599a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788925218.609959:0:6721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c87599a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788925218.609962:0:6721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c87599a800 3 00010000:00080000:2.0:1788925218.609991:0:6721:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c87ffa6000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.128@tcp at head 00010000:00010000:2.0:1788925218.612190:0:6721:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788925218.612422:0:6721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788925218.612458:0:6721:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788925218.612471:0:6721:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x503aa1a44b68e355 00000100:00080000:2.0:1788925218.612481:0:6721:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788925218.612487:0:6721:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98c87ffa6000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1788925218.612521:0:6721:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c85f9ef800 x1875823947686144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788925218.615722:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875823947686144:0@lo:38: 00000100:00100000:0.0:1788925218.615830:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788925218.616530:0:6721:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788925218.616869:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925218.616886:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947686272:0@lo:400: 00000100:00100000:1.0:1788925218.616929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925218.616968:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947686144 00000100:00100000:1.0:1788925218.616975:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947686144 00000100:00100000:1.0:1788925218.617002:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947686272 00000100:00100000:1.0:1788925218.617006:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947686272 00000100:00100000:1.0:1788925218.617031:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925218.617039:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947686272:12345-0@lo:400: 00000100:00100000:1.0:1788925218.617092:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947686272:12345-0@lo:400: Request processed in 53us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925218.617099:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925218.617116:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925218.617120:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875823947686144:12345-0@lo:38: 00010000:00080000:1.0:1788925218.617165:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1788925218.617195:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x503aa1a44b68e35c 00000004:00100000:1.0:1788925218.617209:0:5847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788925218.617243:0:5847:0:(import.c:65:import_set_state_nolock()) ffff98c86f88e800 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788925218.617756:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788925218.618160:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788925218.618186:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788925218.618217:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e347 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925218.618229:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e347 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788925218.618277:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788925218.618279:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788925218.618281:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925218.618282:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925218.618283:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925218.618284:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925218.618286:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788925218.618288:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788925218.618289:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788925218.618295:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925218.618297:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788925218.618301:0:6696:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788925218.618304:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788925218.618305:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788925218.618306:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925218.618307:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925218.618307:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925218.618309:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925218.618309:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788925218.618310:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788925218.618311:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788925218.618312:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925218.618313:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788925218.618332:0:6696:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788925218.618348:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947686400:0@lo:253: 00000100:00100000:3.0:1788925218.618432:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925218.618454:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8457fd900 going to sleep for 11 seconds 00010000:00080000:2.0:1788925218.619530:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c8482c1500 x1875823947686272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925218.619550:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947686272:0@lo:400: 00000100:00100000:2.0:1788925218.619604:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947686400 00000100:00100000:2.0:1788925218.619611:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947686400 00000100:00100000:2.0:1788925218.619670:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788925218.619681:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6696:x1875823947686400:12345-0@lo:253: 20000000:01000000:2.0:1788925218.619716:0:5842:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788925218.619732:0:5842:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788925218.622036:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875823947686144:12345-0@lo:38: Request processed in 4902us (6195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925218.622053:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788925218.630595:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c85f9ef800 x1875823947686144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788925228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925218.630613:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788925218.630623:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788925218.630631:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788925218.630637:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788925218.630640:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98c87ffa6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788925218.630657:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875823947686144:0@lo:38: 00010000:00010000:3.0:1788925218.647118:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788925218.672038:0:5842:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788925218.672060:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788925218.672115:0:5863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788925218.672121:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788925218.672143:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.672162:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e2c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e2bb expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.672171:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.672214:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e2c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e2bb expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925218.672232:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e2c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e2bb expref: 13 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925218.672247:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1875823947686528:0@lo:104: 00000100:00100000:1.0:1788925218.672313:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925218.672374:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17180 going to sleep for 11 seconds 00000100:00100000:2.0:1788925218.672438:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947686528 00000100:00100000:2.0:1788925218.672446:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947686528 00000100:00100000:2.0:1788925218.672494:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925218.672503:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:5863:x1875823947686528:12345-0@lo:104: 00010000:00010000:2.0:1788925218.672516:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c840031c00/0x503aa1a44b68e2bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e2c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.672572:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788925218.672578:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:5863:x1875823947686528:12345-0@lo:104: Request processed in 76us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925218.672586:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925218.672625:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1875823947686528:0@lo:104: 00010000:00010000:2.0:1788925218.672643:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.672670:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925218.672676:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c840031c00/0x503aa1a44b68e2bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e2c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.672683:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c840031c00 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:2.0:1788925218.672687:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c840031c00/0x503aa1a44b68e2bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e2c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.672708:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c840031c00/0x503aa1a44b68e2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e2c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925218.672715:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c840031c00/0x503aa1a44b68e2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e2c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925218.672721:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788925218.672748:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c840031c00/0x503aa1a44b68e2bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e2c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.672755:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788925218.672772:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c840031c00/0x503aa1a44b68e2bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e2c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.672779:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c840031c00/0x503aa1a44b68e2bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e2c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.672793:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925218.672795:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925218.672797:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925218.672814:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947686656:0@lo:103: 00000100:00100000:2.0:1788925218.672845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925218.672889:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947686656 00000100:00100000:2.0:1788925218.672893:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947686656 00010000:00010000:2.0:1788925218.672909:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e2c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e2bb expref: 14 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925218.672932:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925218.672939:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844a03050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:3306:x1875823947686656:12345-0@lo:103: 00010000:00010000:2.0:1788925218.672954:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925218.672959:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e2c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e2bb expref: 14 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.672969:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e2c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e2bb expref: 14 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.672982:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e2c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e2bb expref: 14 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.672993:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.673000:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788925218.673013:0:5833:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002006313s 00010000:00010000:2.0:1788925218.673018:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.673024:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.673031:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.673038:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.673044:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861866200 already unused, calling callback (ffffffffc15c6230) 00010000:00010000:2.0:1788925218.673048:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.673062:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.673076:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.673084:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788925218.673113:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844a03050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:3306:x1875823947686656:12345-0@lo:103: Request processed in 175us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925218.673120:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788925218.673168:0:5863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.673176:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925218.673182:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c861866200/0x503aa1a44b68e363 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925218.673206:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947686656:0@lo:103: 00000100:00100000:1.0:1788925218.683092:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:6696:x1875823947686400:12345-0@lo:253: Request processed in 63400us (64648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925218.683124:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788925218.683225:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6696:1875823947686400:0@lo:253: 10000000:01000000:3.0:1788925218.683244:0:6696:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788925218.683248:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788925218.683250:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788925218.683251:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925218.683252:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925218.683253:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925218.683254:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925218.683256:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788925218.683257:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788925218.683258:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788925218.683260:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925218.683261:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788925218.683275:0:6696:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788925218.688261:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788925218.688572:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788925218.688834:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788925218.689248:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788925218.689491:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788925218.689754:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788925218.691088:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788925218.989293:0:6696:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788925218.989316:0:6696:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788925218.995686:0:6696:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788925218.995765:0:6696:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788925218.995787:0:6696:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788925218.995822:0:6696:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788925219.670878:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925220.694537:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925221.718997:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788925221.858336:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788925221.858346:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c844c1e800 from 21 10000000:01000000:0.0:1788925221.858351:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788925221.858422:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.858434:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.858445:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925221.858467:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947686784:0@lo:101: 00000100:00100000:0.0:1788925221.858543:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925221.858582:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847f76000 going to sleep for 11 seconds 00000100:00100000:3.0:1788925221.859281:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947686784 00000100:00100000:3.0:1788925221.859289:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947686784 00000100:00100000:3.0:1788925221.859344:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788925221.859352:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5844:x1875823947686784:12345-0@lo:101: 00010000:00010000:3.0:1788925221.859365:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925221.859384:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c8821c6600/0x503aa1a44b68e371 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e36a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.859424:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c8821c6600/0x503aa1a44b68e371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e36a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.859434:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c8821c6600/0x503aa1a44b68e371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e36a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.859443:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8821c6600, rc 0) 00000100:00100000:3.0:1788925221.859481:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947686784:12345-0@lo:101: Request processed in 130us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925221.859488:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788925221.864067:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947686784:0@lo:101: 00010000:00010000:0.0:1788925221.864100:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e371 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.864114:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e371 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925221.864192:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947686912:0@lo:501: 00000100:00100000:0.0:1788925221.864318:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925221.864371:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847f76000 going to sleep for 11 seconds 00000100:00100000:1.0:1788925221.864725:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947686912 00000100:00100000:1.0:1788925221.864732:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947686912 00000100:00100000:1.0:1788925221.864776:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788925221.864785:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947686912:12345-0@lo:501: 00000100:00100000:1.0:1788925221.866027:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947686912:12345-0@lo:501: Request processed in 1237us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925221.866038:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788925221.870329:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947686912:0@lo:501: 00000100:00100000:0.0:1788925221.870451:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947687040:0@lo:503: 00000100:00100000:0.0:1788925221.870531:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925221.871282:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847f76000 going to sleep for 11 seconds 00000100:00100000:3.0:1788925221.873344:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947687040 00000100:00100000:3.0:1788925221.873357:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947687040 00000100:00100000:3.0:1788925221.873442:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788925221.873454:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947687040:12345-0@lo:503: 00000100:00100000:3.0:1788925221.874132:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947687040:12345-0@lo:503: Request processed in 678us (3599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925221.874142:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788925221.875811:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947687040:0@lo:503: 00000100:00100000:1.0:1788925221.876358:0:6842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6842:1875823947687168:0@lo:502: 00000100:00100000:1.0:1788925221.876471:0:6842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925221.876518:0:6842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8466e0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788925221.876587:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947687168 00000100:00100000:3.0:1788925221.876604:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947687168 00000100:00100000:3.0:1788925221.876642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788925221.876651:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6842:x1875823947687168:12345-0@lo:502: 00000100:00100000:3.0:1788925221.876954:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6842:x1875823947687168:12345-0@lo:502: Request processed in 304us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925221.876962:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788925221.877094:0:6842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6842:1875823947687168:0@lo:502: 00000100:00100000:1.0:1788925221.877139:0:6842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6842:1875823947687296:0@lo:502: 00000100:00100000:1.0:1788925221.877172:0:6842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925221.877204:0:6842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8466e0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788925221.877358:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947687296 00000100:00100000:3.0:1788925221.877363:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947687296 00000100:00100000:3.0:1788925221.877425:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788925221.877433:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6842:x1875823947687296:12345-0@lo:502: 00000100:00100000:3.0:1788925221.877561:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:6842:x1875823947687296:12345-0@lo:502: Request processed in 129us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925221.877568:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788925221.877693:0:6842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6842:1875823947687296:0@lo:502: 00000040:00080000:1.0:1788925221.877713:0:6842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788925221.878452:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788925221.878474:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788925221.878484:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e371 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.878497:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e371 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925221.878507:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788925221.878510:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c844c1e800 from 4 10000000:01000000:3.0:1788925221.878512:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788925221.878543:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.878550:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.878559:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925221.878586:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947687424:0@lo:101: 00000100:00100000:3.0:1788925221.878638:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925221.878669:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8457fd000 going to sleep for 11 seconds 00000100:00100000:2.0:1788925221.879219:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947687424 00000100:00100000:2.0:1788925221.879225:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947687424 00000100:00100000:2.0:1788925221.879268:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788925221.879277:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947687424:12345-0@lo:101: 00010000:00010000:2.0:1788925221.879287:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925221.879300:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e37f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e378 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.879324:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e378 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.879335:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e378 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.879344:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c85c219800, rc 0) 00000100:00100000:2.0:1788925221.879416:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947687424:12345-0@lo:101: Request processed in 123us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925221.879423:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788925221.879467:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947687424:0@lo:101: 00010000:00010000:2.0:1788925221.879479:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e37f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.879488:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e37f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925221.879539:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947687552:0@lo:256: 00000100:00100000:2.0:1788925221.879571:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925221.879609:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c875397f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788925221.879762:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947687552 00000100:00100000:1.0:1788925221.879766:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947687552 00000100:00100000:1.0:1788925221.879798:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788925221.879805:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947687552:12345-0@lo:256: 20000000:01000000:1.0:1788925221.879831:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788925221.879849:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788925221.879852:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788925221.879926:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947687552:12345-0@lo:256: Request processed in 120us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925221.879938:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788925221.881088:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947687552:0@lo:256: 10000000:01000000:2.0:1788925221.881152:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788925221.881160:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e37f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.881169:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e37f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925221.881245:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788925221.881248:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788925221.881252:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788925221.881278:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.881286:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.881295:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925221.881312:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947687680:0@lo:101: 00000100:00100000:2.0:1788925221.881358:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925221.881669:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947687680 00000100:00100000:1.0:1788925221.881675:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947687680 00000100:00100000:1.0:1788925221.881719:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788925221.881728:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947687680:12345-0@lo:101: 00010000:00010000:1.0:1788925221.881741:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925221.881756:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c861866800/0x503aa1a44b68e38d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e386 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925221.881779:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c861866800/0x503aa1a44b68e38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e386 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925221.881788:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c861866800/0x503aa1a44b68e38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e386 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925221.881796:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c861866800, rc 0) 00000100:00100000:1.0:1788925221.881844:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947687680:12345-0@lo:101: Request processed in 117us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925221.881850:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788925221.885644:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c875397f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788925221.885688:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947687680:0@lo:101: 00010000:00010000:3.0:1788925221.885711:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e38d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.885724:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e38d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925221.885796:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947687808:0@lo:501: 00000100:00100000:3.0:1788925221.886296:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925221.886373:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8457fd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925221.895250:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947687808 00000100:00100000:2.0:1788925221.895266:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947687808 00000100:00100000:3.0:1788925221.896784:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788925221.896800:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947687808:12345-0@lo:501: 00000100:00100000:3.0:1788925221.897196:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947687808:12345-0@lo:501: Request processed in 401us (10900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925221.897205:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788925221.897312:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947687808:0@lo:501: 00000100:00100000:2.0:1788925221.897361:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947687936:0@lo:503: 00000100:00100000:2.0:1788925221.897483:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925221.897624:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c875397300 going to sleep for 11 seconds 00000100:00100000:0.0:1788925221.897653:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947687936 00000100:00100000:0.0:1788925221.897660:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947687936 00000100:00100000:0.0:1788925221.897729:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788925221.897737:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947687936:12345-0@lo:503: 00000100:00100000:0.0:1788925221.898019:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947687936:12345-0@lo:503: Request processed in 282us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925221.898026:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788925221.898093:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947687936:0@lo:503: 00000100:00100000:3.0:1788925221.898542:0:6843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6843:1875823947688064:0@lo:502: 00000100:00100000:3.0:1788925221.898577:0:6843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925221.898732:0:6843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8457fd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925221.898794:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947688064 00000100:00100000:1.0:1788925221.898799:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947688064 00000100:00100000:1.0:1788925221.898825:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788925221.898832:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:6843:x1875823947688064:12345-0@lo:502: 00000100:00100000:1.0:1788925221.899050:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:6843:x1875823947688064:12345-0@lo:502: Request processed in 218us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925221.899058:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788925221.899137:0:6843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6843:1875823947688064:0@lo:502: 00000020:01000000:3.0:1788925221.899165:0:6843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788925221.899172:0:6843:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788925221.899178:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925221.899180:0:6843:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788925221.899185:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788925221.899189:0:6843:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.128@tcp to nid 0x20000c0a8cc80 (192.168.204.128@tcp) 00000020:01000000:3.0:1788925221.899213:0:6843:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788925221.899216:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788925221.899230:0:6843:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98c874f0cd28) 00000020:00000080:3.0:1788925221.899249:0:6843:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788925221.899255:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788925221.899334:0:6843:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788925221.899339:0:6843:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788925221.899347:0:6843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x503aa1a44b68e39b 00010000:00080000:3.0:1788925221.899375:0:6843:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c848256000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:3.0:1788925221.899668:0:6843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788925221.930440:0:6843:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788925221.930469:0:6843:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788925221.931202:0:6843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788925221.931389:0:6843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788925221.931472:0:6843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788925221.931533:0:6843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788925221.935760:0:6845:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788925221.935771:0:6845:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788925221.936465:0:6843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788925221.936478:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788925221.936522:0:6843:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788925221.936543:0:6843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x503aa1a44b68e3a2 00000100:00080000:1.0:1788925221.936553:0:6843:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788925221.936558:0:6843:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98c848256000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1788925221.936605:0:6843:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c84a0f0700 x1875823947688192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788925221.936629:0:6843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788925221.936705:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947688320:0@lo:400: 00000100:00100000:1.0:1788925221.936772:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925221.936833:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925221.936840:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947688448:0@lo:400: 00000100:00100000:1.0:1788925221.936865:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925221.936909:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947688320 00000100:00100000:1.0:1788925221.936981:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947688320 00000100:00100000:1.0:1788925221.937023:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947688448 00000100:00100000:1.0:1788925221.937026:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947688448 00000100:00100000:1.0:1788925221.937055:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788925221.937063:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947688320:12345-0@lo:400: 00000100:00100000:1.0:1788925221.937113:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947688320:12345-0@lo:400: Request processed in 50us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925221.937121:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788925221.937138:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788925221.937144:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947688448:12345-0@lo:400: 00000100:00100000:1.0:1788925221.937171:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947688448:12345-0@lo:400: Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925221.937177:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788925221.937214:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c84a0f1880 x1875823947688448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925221.937234:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947688448:0@lo:400: 00010000:00080000:1.0:1788925221.937248:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c84a0f0000 x1875823947688320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925221.937255:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947688320:0@lo:400: 00000020:01000000:1.0:1788925221.937320:0:6843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925221.937325:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925221.937327:0:6843:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788925221.937331:0:6843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925221.937335:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925221.937336:0:6843:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788925221.937339:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788925221.937341:0:6843:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788925221.937364:0:6843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6843:1875823947688576:0@lo:502: 00000100:00100000:1.0:1788925221.937429:0:6843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925221.937452:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947688576 00000100:00100000:1.0:1788925221.937456:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947688576 00000100:00100000:1.0:1788925221.937484:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788925221.937491:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:6843:x1875823947688576:12345-0@lo:502: 00000100:00100000:1.0:1788925221.937708:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:6843:x1875823947688576:12345-0@lo:502: Request processed in 217us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925221.937715:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788925221.937752:0:6843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8466e0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788925221.937764:0:6843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:6843:1875823947688576:0@lo:502: 00000020:01000000:1.0:1788925221.937784:0:6843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925221.937789:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925221.937791:0:6843:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788925221.937801:0:6843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1788925221.937987:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875823947688192:0@lo:8: 00000100:00100000:3.0:1788925221.938038:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788925221.938195:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:2.0:1788925221.938214:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788925221.938231:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788925221.938241:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e38d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.938252:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e38d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925221.938262:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788925221.938265:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98c844a44d28 from 1 10000000:01000000:2.0:1788925221.938268:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788925221.938292:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.938300:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.938310:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925221.938322:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947688704:0@lo:101: 00000100:00100000:2.0:1788925221.938350:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925221.938436:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947688192 00000100:00100000:1.0:1788925221.938442:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947688192 00000100:00100000:1.0:1788925221.938465:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925221.938470:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875823947688192:12345-0@lo:8: 00010000:00080000:1.0:1788925221.938494:0:6699:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:1.0:1788925221.938519:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x503aa1a44b68e3b0 00002000:00100000:1.0:1788925221.938561:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98c86f88b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788925221.938565:0:6699:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788925221.938569:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788925221.938698:0:6699:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788925221.938841:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788925221.938866:0:6699:0:(import.c:65:import_set_state_nolock()) ffff98c86f889800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925221.939018:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c875397900 going to sleep for 11 seconds 00000100:00100000:1.0:1788925221.940009:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875823947688192:12345-0@lo:8: Request processed in 442us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925221.940019:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788925221.942191:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c84a0f0700 x1875823947688192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788925231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925221.942221:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788925221.942234:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788925221.942244:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788925221.942252:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788925221.942255:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98c848256000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788925221.942281:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788925221.942288:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875823947688192:0@lo:8: 00000004:00080000:3.0:1788925221.945195:0:6845:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788925221.945501:0:6845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 211074099291ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788925221.945995:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947688704 00000100:00100000:3.0:1788925221.946007:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947688704 00000100:00100000:3.0:1788925221.946070:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788925221.946081:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947688704:12345-0@lo:101: 00010000:00010000:3.0:1788925221.946097:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925221.946115:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e3b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e3a9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.946142:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e3a9 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.946152:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e3a9 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.946160:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8821c7600, rc 0) 00000100:00100000:3.0:1788925221.946238:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947688704:12345-0@lo:101: Request processed in 159us (7886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925221.946245:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788925221.946899:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947688704:0@lo:101: 00010000:00010000:2.0:1788925221.946982:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e3b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.946993:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e3b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925221.947070:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947688832:0@lo:501: 00000100:00100000:2.0:1788925221.947109:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925221.947148:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c875397900 going to sleep for 11 seconds 00000100:00100000:2.0:1788925221.947165:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947688832 00000100:00100000:2.0:1788925221.947170:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947688832 00000100:00100000:2.0:1788925221.947199:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788925221.947206:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947688832:12345-0@lo:501: 00000100:00100000:2.0:1788925221.947436:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947688832:12345-0@lo:501: Request processed in 229us (326us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788925221.947444:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788925221.947479:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947688832:0@lo:501: 10000000:01000000:2.0:1788925221.947500:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788925221.947507:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e3b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.947515:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e3b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925222.012848:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925222.012872:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947688960:0@lo:13: 00000100:00100000:1.0:1788925222.012957:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925222.013028:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947688960 00000100:00100000:1.0:1788925222.013035:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947688960 00000100:00100000:1.0:1788925222.013083:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925222.013092:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875823947688960:12345-0@lo:13: 00002000:00000024:1.0:1788925222.013125:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788925222.013169:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875823947688960:12345-0@lo:13: Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925222.013175:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788925222.013205:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788925222.013233:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c84a0f0000 x1875823947688960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925222.013252:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947688960:0@lo:13: 00000004:00080000:1.0:1788925222.013272:0:6847:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788925222.013290:0:6847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6847:1875823947689088:0@lo:7: 00000100:00100000:1.0:1788925222.013316:0:6847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925222.013340:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947689088 00000100:00100000:1.0:1788925222.013344:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947689088 00000100:00100000:1.0:1788925222.013369:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925222.013376:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6847:x1875823947689088:12345-0@lo:7: 00002000:00080000:1.0:1788925222.022380:0:6702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788925222.022389:0:6702:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788925222.022499:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6847:x1875823947689088:12345-0@lo:7: Request processed in 9119us (9178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925222.022510:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925222.022599:0:6847:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8466e0480 going to sleep for 11 seconds 00010000:00080000:1.0:1788925222.022631:0:6847:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c84a0f0000 x1875823947689088/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788925238 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925222.022645:0:6847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6847:1875823947689088:0@lo:7: 00000004:00080000:1.0:1788925222.022658:0:6847:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788925222.022700:0:6847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6847:1875823947689216:0@lo:5: 00000100:00100000:1.0:1788925222.022734:0:6847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925222.027837:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947689216 00000100:00100000:1.0:1788925222.027853:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947689216 00000100:00100000:1.0:1788925222.027903:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925222.027922:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6847:x1875823947689216:12345-0@lo:5: 00002000:00080000:1.0:1788925222.027968:0:6701:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788925222.027973:0:6701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788925222.028325:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6847:x1875823947689216:12345-0@lo:5: Request processed in 413us (5589us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788925222.028332:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925222.028418:0:6847:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8466e0480 going to sleep for 11 seconds 00010000:00080000:1.0:1788925222.028451:0:6847:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c84a0f0000 x1875823947689216/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788925238 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925222.028468:0:6847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6847:1875823947689216:0@lo:5: 00000004:00080000:1.0:1788925222.028481:0:6847:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788925222.028520:0:6847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6847:1875823947689344:0@lo:700: 00000100:00100000:1.0:1788925222.028555:0:6847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925222.028599:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947689344 00000100:00100000:1.0:1788925222.028603:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947689344 00000100:00100000:1.0:1788925222.028631:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925222.028638:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6847:x1875823947689344:12345-0@lo:700: 00000100:00100000:1.0:1788925222.028664:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6708:1875823947689472:0@lo:700: 00000100:00100000:1.0:1788925222.028691:0:6708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925222.028711:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8466e0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788925222.028732:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947689472 00000100:00100000:1.0:1788925222.028736:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947689472 00000100:00100000:1.0:1788925222.028760:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925222.028766:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6708:x1875823947689472:12345-0@lo:700: 00000100:00100000:1.0:1788925222.029203:0:6847:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8466e0480 going to sleep for 11 seconds 00000004:00080000:1.0:1788925222.069200:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1788925222.110583:0:5854:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788925222.116511:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6708:x1875823947689472:12345-0@lo:700: Request processed in 87734us (87807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925222.116533:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788925222.117034:0:6708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c84a0f2d80 x1875823947689472/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788925238 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925222.117050:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6708:1875823947689472:0@lo:700: 40000000:02000000:1.0:1788925222.117064:0:6708:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1788925222.234607:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6847:x1875823947689344:12345-0@lo:700: Request processed in 205948us (206031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925222.234630:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788925222.234793:0:6847:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c84a0f3800 x1875823947689344/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788925238 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925222.234811:0:6847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6847:1875823947689344:0@lo:700: 00000001:00080000:0.0:1788925222.235597:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788925222.235613:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:1.0:1788925222.286428:0:6847:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788925222.296819:0:6847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6847:1875823947689600:0@lo:5: 00000100:00100000:1.0:1788925222.296915:0:6847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925222.296983:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947689600 00000100:00100000:1.0:1788925222.296992:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947689600 00000100:00100000:1.0:1788925222.297050:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788925222.297060:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6847:x1875823947689600:12345-0@lo:5: 00000100:00100000:2.0:1788925222.301739:0:6847:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8737d5840 going to sleep for 11 seconds 00002000:00080000:1.0:1788925222.304384:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788925222.305070:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788925222.311682:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6847:x1875823947689600:12345-0@lo:5: Request processed in 14614us (14757us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788925222.311697:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788925222.311803:0:6847:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c84a0f3800 x1875823947689600/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788925238 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925222.311827:0:6847:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788925222.311847:0:6847:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98c84a0f3800 x1875823947689600/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788925238 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925222.311860:0:6847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6847:1875823947689600:0@lo:5: 00000004:00080000:2.0:1788925222.311876:0:6847:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788925222.750515:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925223.768431:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925224.791930:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925225.821838:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925226.839562:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788925227.189037:0:7068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788925227.421543:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947689728:0@lo:13: 00000100:00100000:3.0:1788925227.421623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925227.421697:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947689728 00000100:00100000:3.0:1788925227.421704:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947689728 00000100:00100000:3.0:1788925227.421759:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925227.421768:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875823947689728:12345-0@lo:13: 00002000:00000024:3.0:1788925227.421807:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925227.422512:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875823947689728:12345-0@lo:13: Request processed in 743us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925227.422520:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788925227.422546:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788925227.422585:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c8482c2300 x1875823947689728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925227.422606:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947689728:0@lo:13: 00000100:00100000:3.0:1788925227.427965:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947689856:0@lo:400: 00000100:00100000:3.0:1788925227.428041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925227.428090:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925227.428097:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947689984:0@lo:400: 00000100:00100000:3.0:1788925227.428124:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925227.428154:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925227.428163:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823947690112:0@lo:400: 00000100:00100000:3.0:1788925227.428189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925227.428217:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947689984 00000100:00100000:3.0:1788925227.428224:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947689984 00000100:00100000:3.0:1788925227.428264:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947690112 00000100:00100000:3.0:1788925227.428268:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947690112 00000100:00100000:3.0:1788925227.428294:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788925227.428303:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947689984:12345-0@lo:400: 00000100:00100000:3.0:1788925227.428356:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947689984:12345-0@lo:400: Request processed in 54us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925227.428374:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788925227.428391:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788925227.428414:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823947690112:12345-0@lo:400: 00000100:00100000:3.0:1788925227.428446:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823947690112:12345-0@lo:400: Request processed in 49us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925227.428452:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788925227.428470:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788925227.428507:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c8482c0e00 x1875823947689984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925227.428529:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947689984:0@lo:400: 00010000:00080000:3.0:1788925227.428561:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c8482c0a80 x1875823947690112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925227.428569:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823947690112:0@lo:400: 00000100:00100000:2.0:1788925227.429507:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947689856 00000100:00100000:2.0:1788925227.429515:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947689856 00000100:00100000:2.0:1788925227.429563:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788925227.429571:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:3307:x1875823947689856:12345-0@lo:400: 00000100:00100000:2.0:1788925227.429623:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:3307:x1875823947689856:12345-0@lo:400: Request processed in 53us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925227.429629:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788925227.445171:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947689856:0@lo:400: 00000001:00080000:2.0:1788925227.523764:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788925227.863515:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925228.888847:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925229.910720:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925230.935631:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925231.958711:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925232.537131:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947690368:0@lo:400: 00000100:00100000:3.0:1788925232.537226:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925232.537287:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925232.537295:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947690496:0@lo:400: 00000100:00100000:3.0:1788925232.537319:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925232.537377:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947690368 00000100:00100000:3.0:1788925232.537386:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947690368 00000100:00100000:3.0:1788925232.537455:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947690496 00000100:00100000:3.0:1788925232.537459:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947690496 00000100:00100000:3.0:1788925232.537486:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788925232.537495:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947690368:12345-0@lo:400: 00000100:00100000:3.0:1788925232.537543:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947690368:12345-0@lo:400: Request processed in 49us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925232.537550:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788925232.537567:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788925232.537572:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947690496:12345-0@lo:400: 00000100:00100000:3.0:1788925232.537599:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947690496:12345-0@lo:400: Request processed in 27us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925232.537605:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788925232.537635:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788925232.537926:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c84a0f0700 x1875823947690496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925232.537940:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947690496:0@lo:400: 00010000:00080000:3.0:1788925232.537951:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c84a0f0000 x1875823947690368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925232.537959:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947690368:0@lo:400: 00000100:00100000:0.0:1788925232.539204:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947690240:0@lo:400: 00000100:00100000:0.0:1788925232.539266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925232.539305:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925232.539312:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947690624:0@lo:400: 00000100:00100000:0.0:1788925232.539343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925232.541947:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947690240 00000100:00100000:3.0:1788925232.541962:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947690240 00000100:00100000:3.0:1788925232.542032:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788925232.542044:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:3306:x1875823947690240:12345-0@lo:400: 00000100:00100000:3.0:1788925232.542148:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:3306:x1875823947690240:12345-0@lo:400: Request processed in 105us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925232.542155:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788925232.542694:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947690240:0@lo:400: 00000100:00100000:2.0:1788925232.545834:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947690624 00000100:00100000:2.0:1788925232.545851:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947690624 00000100:00100000:2.0:1788925232.545924:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788925232.545936:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947690624:12345-0@lo:400: 00000100:00100000:2.0:1788925232.546030:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947690624:12345-0@lo:400: Request processed in 97us (6686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925232.546038:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788925232.546069:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788925232.558496:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c875984000 x1875823947690624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925232.558532:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788925232.558551:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947690624:0@lo:400: 00000100:00100000:0.0:1788925232.558637:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947690752:0@lo:13: 00000100:00100000:0.0:1788925232.558702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925232.558857:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947690752 00000100:00100000:1.0:1788925232.558864:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947690752 00000100:00100000:1.0:1788925232.558933:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925232.558944:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947690752:12345-0@lo:13: 00002000:00000024:1.0:1788925232.558982:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925232.565899:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947690752:12345-0@lo:13: Request processed in 6933us (7172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925232.565914:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788925232.571198:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c85f9ef100 x1875823947690752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925232.571230:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947690752:0@lo:13: 00010000:00010000:1.0:1788925232.985627:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925234.007328:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925235.032182:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925236.054638:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925237.088358:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925237.656560:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947690880:0@lo:400: 00000100:00100000:1.0:1788925237.656730:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.656786:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925237.656792:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947691008:0@lo:400: 00000100:00100000:1.0:1788925237.656824:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.656854:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947691136:0@lo:400: 00000100:00100000:1.0:1788925237.656879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.656897:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788925237.656902:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947691264:0@lo:400: 00000100:00100000:1.0:1788925237.656930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.656960:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947690880 00000100:00100000:1.0:1788925237.656967:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947690880 00000100:00100000:1.0:1788925237.657009:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788925237.657018:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:3307:x1875823947690880:12345-0@lo:400: 00000100:00100000:1.0:1788925237.657064:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:3307:x1875823947690880:12345-0@lo:400: Request processed in 48us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925237.657071:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788925237.657100:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947691008 00000100:00100000:1.0:1788925237.657103:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947691008 00000100:00100000:1.0:1788925237.657123:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947691136 00000100:00100000:1.0:1788925237.657125:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947691136 00000100:00100000:1.0:1788925237.657145:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925237.657156:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947691008:12345-0@lo:400: 00000100:00100000:1.0:1788925237.657189:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947691008:12345-0@lo:400: Request processed in 33us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925237.657195:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925237.657207:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788925237.657212:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947691136:12345-0@lo:400: 00000100:00100000:1.0:1788925237.657239:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947691136:12345-0@lo:400: Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925237.657246:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788925237.657265:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947691264 00000100:00100000:1.0:1788925237.657268:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947691264 00000100:00100000:1.0:1788925237.657293:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925237.657300:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947691264:12345-0@lo:400: 00000100:00100000:1.0:1788925237.657338:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947691264:12345-0@lo:400: Request processed in 39us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925237.657344:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788925237.657363:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788925237.657367:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788925237.657471:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c875986d80 x1875823947691264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925237.657485:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947691264:0@lo:400: 00010000:00080000:1.0:1788925237.657496:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c875984380 x1875823947691136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925237.657504:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947691136:0@lo:400: 00010000:00080000:1.0:1788925237.657531:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c875987480 x1875823947691008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925237.657551:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947691008:0@lo:400: 00000100:00100000:1.0:1788925237.657561:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947690880:0@lo:400: 00000100:00100000:1.0:1788925237.673245:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947691392:0@lo:13: 00000100:00100000:1.0:1788925237.673338:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.673495:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947691392 00000100:00100000:1.0:1788925237.673503:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947691392 00000100:00100000:1.0:1788925237.673706:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788925237.673716:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947691392:12345-0@lo:13: 00002000:00000024:1.0:1788925237.673756:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925237.673812:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947691392:12345-0@lo:13: Request processed in 97us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925237.673820:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788925237.673869:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c862fe6300 x1875823947691392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925237.673889:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947691392:0@lo:13: 00010000:00010000:3.0:1788925238.102827:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925239.131338:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788925239.671934:0:7636:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788925239.671937:0:7636:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788925239.672193:0:7636:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c87ffa4000 00000020:01000004:2.0:1788925239.672212:0:7636:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788925239.672225:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788925239.672241:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98c87ff98000) 00000020:00000080:2.0:1788925239.672259:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788925239.698487:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788925239.698914:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788925239.745513:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788925239.767036:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788925239.767300:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788925239.767370:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788925239.767397:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788925239.768026:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788925239.768039:0:7636:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788925239.768197:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x503aa1a44b68e3c5 00000020:01000004:2.0:1788925239.768207:0:7636:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788925239.768235:0:7636:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.128@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788925239.768239:0:7636:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788925239.768245:0:7636:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788925239.768267:0:7636:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788925239.768280:0:7636:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788925239.830845:0:7636:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788925239.830894:0:7636:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.128@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788925239.830975:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788925239.830978:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788925239.830984:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925239.830985:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788925239.830987:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925239.830988:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925239.830989:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788925239.830991:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788925239.830992:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788925239.830994:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925239.830995:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788925239.830998:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788925239.831000:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788925239.831001:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788925239.831002:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925239.831003:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788925239.831004:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925239.831005:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925239.831006:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788925239.831007:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788925239.831007:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788925239.831008:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925239.831009:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788925239.831036:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788925239.831057:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947691520:0@lo:253: 00000100:00100000:2.0:1788925239.831131:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.831174:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8478f53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925239.831701:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947691520 00000100:00100000:0.0:1788925239.831713:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947691520 00000100:00100000:0.0:1788925239.831783:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788925239.831793:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:7636:x1875823947691520:12345-0@lo:253: 20000000:01000000:0.0:1788925239.831828:0:5842:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788925239.831832:0:5842:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788925239.831838:0:5842:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788925239.831841:0:5842:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788925239.832925:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788925239.833158:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788925239.833173:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788925239.833214:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788925239.833222:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788925239.833255:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788925239.833321:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788925239.833719:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788925239.833739:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.128@tcp 20000000:01000000:0.0:1788925239.833741:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:0.0:1788925239.833776:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788925239.833783:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788925239.833846:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788925239.833855:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:0.0:1788925239.833888:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788925239.833898:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788925239.833930:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788925239.833975:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788925239.836529:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788925239.836563:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.128@tcp 20000000:01000000:0.0:1788925239.836565:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:0.0:1788925239.836607:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788925239.836615:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788925239.836650:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788925239.836656:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:0.0:1788925239.836685:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788925239.836694:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788925239.836736:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788925239.836766:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788925239.836781:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788925239.836783:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788925239.836790:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788925239.836791:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788925239.836794:0:5842:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788925239.836806:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788925239.836808:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788925239.836843:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788925239.836845:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788925239.837797:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788925239.837859:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788925239.838050:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788925239.838371:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788925239.838448:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788925239.838480:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788925239.838490:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788925239.838502:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788925239.840032:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788925239.840122:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788925239.840157:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788925239.841120:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788925239.841161:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788925239.841211:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788925239.841222:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788925239.841224:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788925239.843048:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788925239.843125:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788925239.843182:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788925239.843543:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788925239.843584:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788925239.843777:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788925239.843790:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788925239.843792:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788925239.844720:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788925239.845044:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788925239.845085:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788925239.845149:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1788925239.845178:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788925239.845199:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.845220:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c861866600/0x503aa1a44b68e31d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e316 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.845228:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e340 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.845236:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c8821c6600/0x503aa1a44b68e371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e36a expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.845243:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c861866800/0x503aa1a44b68e38d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e386 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.845250:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e3b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e3a9 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.845259:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.845317:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e3a9 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.845337:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e3b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e3a9 expref: 16 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925239.845352:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1875823947691648:0@lo:104: 00000100:00100000:1.0:1788925239.849006:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788925239.849123:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c861866800/0x503aa1a44b68e38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e386 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.849139:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c861866800/0x503aa1a44b68e38d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e386 expref: 16 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925239.849156:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875987480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1875823947691776:0@lo:104: 00010000:00010000:1.0:1788925239.849199:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c8821c6600/0x503aa1a44b68e371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e36a expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925239.849233:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1788925239.849236:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c8821c6600/0x503aa1a44b68e371 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e36a expref: 16 pid: 5839 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925239.849249:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875984380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1875823947691904:0@lo:104: 00000100:00100000:2.0:1788925239.849259:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925239.849328:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947691648 00000100:00100000:3.0:1788925239.849337:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947691648 00000100:00100000:3.0:1788925239.849377:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947691776 00000100:00100000:3.0:1788925239.849379:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947691776 00000100:00100000:3.0:1788925239.849391:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788925239.849423:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84789a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+4:5842:x1875823947691648:12345-0@lo:104: 00010000:00010000:3.0:1788925239.849438:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e3b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925239.852234:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.852433:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788925239.852443:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1788925239.852786:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e340 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.852803:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e340 expref: 16 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925239.852817:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875984e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1875823947692032:0@lo:104: 00000100:00100000:1.0:1788925239.852872:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788925239.852900:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c861866600/0x503aa1a44b68e31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e316 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.852909:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c861866600/0x503aa1a44b68e31d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e316 expref: 16 pid: 5839 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925239.852917:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875987800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1875823947692160:0@lo:104: 00000100:00100000:1.0:1788925239.852937:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925239.852947:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847f76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788925239.853056:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947691904 00000100:00100000:2.0:1788925239.853063:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947691904 00000100:00100000:2.0:1788925239.853099:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788925239.853105:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947692032 00000100:00100000:2.0:1788925239.853109:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947692032 00000100:00100000:2.0:1788925239.853118:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788925239.853121:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947692160 00000100:00100000:2.0:1788925239.853123:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947692160 00000100:00100000:0.0:1788925239.853283:0:7643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788925239.853294:0:7643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+7:5842:x1875823947691776:12345-0@lo:104: 00010000:00010000:0.0:1788925239.853313:0:7643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e38d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853385:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788925239.853391:0:7643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+7:5842:x1875823947691776:12345-0@lo:104: Request processed in 99us (4133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.853423:0:7643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788925239.853443:0:7643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788925239.853448:0:7643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+6:5842:x1875823947691904:12345-0@lo:104: 00010000:00010000:0.0:1788925239.853465:0:7643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e371 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853504:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788925239.853509:0:7643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+6:5842:x1875823947691904:12345-0@lo:104: Request processed in 61us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.853515:0:7643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788925239.853531:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788925239.853538:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e38d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853546:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c85c218c00 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:0.0:1788925239.853550:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e38d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853560:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e38d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925239.853568:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e38d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925239.853579:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925239.853621:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e38d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853627:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925239.853643:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e38d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853650:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c85c218c00/0x503aa1a44b68e386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e38d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853663:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925239.853666:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e371 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853671:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c840030600 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:0.0:1788925239.853678:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e371 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853686:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e371 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925239.853692:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e371 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925239.853697:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925239.853710:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e371 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853716:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925239.853736:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e371 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853742:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e36a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e371 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853753:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925239.853755:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925239.853756:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925239.853778:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947692288:0@lo:103: 00000100:00100000:0.0:1788925239.853812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925239.853847:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947692288 00000100:00100000:0.0:1788925239.853851:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947692288 00010000:00010000:0.0:1788925239.853869:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c861866800/0x503aa1a44b68e38d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e386 expref: 17 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925239.853890:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788925239.853895:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:3308:x1875823947692288:12345-0@lo:103: 00010000:00010000:0.0:1788925239.853904:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925239.853909:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c861866800/0x503aa1a44b68e38d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e386 expref: 17 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853917:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c861866800/0x503aa1a44b68e38d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e386 expref: 17 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.853933:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925239.853960:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:3308:x1875823947692288:12345-0@lo:103: Request processed in 65us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.853967:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788925239.854015:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947692288:0@lo:103: 00000100:00100000:0.0:1788925239.854046:0:7643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788925239.854052:0:7643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875984a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+5:5842:x1875823947692032:12345-0@lo:104: 00010000:00010000:0.0:1788925239.854060:0:7643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e347 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854093:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788925239.854097:0:7643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875984a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+5:5842:x1875823947692032:12345-0@lo:104: Request processed in 46us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.854102:0:7643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788925239.854114:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925239.854117:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e347 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854123:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c85c218800 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:0.0:1788925239.854125:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e347 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854131:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e347 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925239.854137:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e347 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925239.854141:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925239.854157:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e347 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854162:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925239.854168:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e347 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854180:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c85c218800/0x503aa1a44b68e340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e347 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854188:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925239.854190:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925239.854191:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925239.854212:0:7643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788925239.854220:0:7643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+4:5842:x1875823947692160:12345-0@lo:104: 00010000:00010000:0.0:1788925239.854228:0:7643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e31d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.854240:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925239.854263:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788925239.854279:0:7643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+4:5842:x1875823947692160:12345-0@lo:104: Request processed in 51us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.854285:0:7643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788925239.854299:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925239.854303:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e31d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854309:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c840030a00 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:0.0:1788925239.854312:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e31d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854319:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e31d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925239.854325:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e31d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925239.854340:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925239.854368:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e31d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854374:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925239.854383:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e31d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854388:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e316 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e31d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854418:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925239.854420:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925239.854422:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925239.854427:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788925239.854435:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947692672:0@lo:103: 00000100:00100000:0.0:1788925239.854460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925239.854487:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947692672 00000100:00100000:0.0:1788925239.854491:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947692672 00010000:00010000:0.0:1788925239.854505:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c861866600/0x503aa1a44b68e31d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e316 expref: 17 pid: 5839 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925239.854524:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788925239.854529:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:3308:x1875823947692672:12345-0@lo:103: 00010000:00010000:0.0:1788925239.854536:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925239.854540:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c861866600/0x503aa1a44b68e31d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e316 expref: 17 pid: 5839 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854548:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c861866600/0x503aa1a44b68e31d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e316 expref: 17 pid: 5839 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.854565:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925239.854592:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:3308:x1875823947692672:12345-0@lo:103: Request processed in 62us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.854598:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788925239.854622:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947692672:0@lo:103: 00000100:00100000:1.0:1788925239.854689:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947692416:0@lo:103: 00000100:00100000:1.0:1788925239.854717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925239.854817:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788925239.854824:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947692544:0@lo:103: 00000100:00100000:1.0:1788925239.854844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925239.854877:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947692416 00000100:00100000:1.0:1788925239.854881:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947692416 00010000:00010000:1.0:1788925239.854899:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c8821c6600/0x503aa1a44b68e371 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e36a expref: 17 pid: 5839 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925239.854916:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947692544 00000100:00100000:1.0:1788925239.854918:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947692544 00010000:00010000:1.0:1788925239.854927:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e347 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e340 expref: 18 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925239.854939:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788925239.854945:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875985180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:3305:x1875823947692416:12345-0@lo:103: 00010000:00010000:1.0:1788925239.855012:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925239.855017:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c8821c6600/0x503aa1a44b68e371 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e36a expref: 18 pid: 5839 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.855027:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c8821c6600/0x503aa1a44b68e371 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e36a expref: 18 pid: 5839 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.855039:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925239.855080:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875985180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:3305:x1875823947692416:12345-0@lo:103: Request processed in 134us (361us total) trans 0 rc 0/0 00010000:00010000:2.0:1788925239.855086:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c861866800/0x503aa1a44b68e38d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e386 expref: 18 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925239.855102:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875987480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1875823947691776:0@lo:104: 00010000:00010000:2.0:1788925239.855115:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c8821c6600/0x503aa1a44b68e371 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e36a expref: 17 pid: 5839 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925239.855125:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875984380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1875823947691904:0@lo:104: 00000100:00100000:2.0:1788925239.855135:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875984e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1875823947692032:0@lo:104: 00000100:00100000:1.0:1788925239.855143:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788925239.855144:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c861866600/0x503aa1a44b68e31d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e316 expref: 16 pid: 5839 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925239.855157:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875987800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1875823947692160:0@lo:104: 00000100:00100000:1.0:1788925239.855164:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925239.855171:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875987100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:3305:x1875823947692544:12345-0@lo:103: 00010000:00010000:1.0:1788925239.855178:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925239.855183:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e340 expref: 14 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.855193:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e340 expref: 14 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.855210:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e340 expref: 14 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.855221:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925239.855243:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875987100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:3305:x1875823947692544:12345-0@lo:103: Request processed in 73us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925239.855249:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788925239.855356:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788925239.855365:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84789a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:5842:x1875823947691648:12345-0@lo:104: Request processed in 5965us (6372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925239.855372:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788925239.855461:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947692544:0@lo:103: 00000100:00100000:1.0:1788925239.855470:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947692416:0@lo:103: 00010000:00010000:0.0:1788925239.855500:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925239.855506:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e3b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.855513:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c85c219200 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:0.0:1788925239.855516:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e3b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.855524:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e3b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925239.855530:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e3b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925239.855535:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925239.855565:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e3b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.855571:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925239.855591:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e3b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.855734:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e3a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e3b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.855760:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925239.855762:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925239.855764:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925239.855815:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1875823947691648:0@lo:104: 00010000:00010000:2.0:1788925239.855843:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925239.855861:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925239.855875:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947692800:0@lo:103: 00000100:00100000:1.0:1788925239.855909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.856029:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947692800 00000100:00100000:2.0:1788925239.856034:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947692800 00010000:00010000:2.0:1788925239.856053:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e3b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e3a9 expref: 13 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925239.856160:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788925239.856168:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875985c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:3307:x1875823947692800:12345-0@lo:103: 00010000:00010000:2.0:1788925239.856190:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925239.856195:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e3b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e3a9 expref: 13 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.856217:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e3a9 expref: 13 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.856229:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c8821c7600/0x503aa1a44b68e3b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e3a9 expref: 13 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.856241:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.856250:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.856262:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.856280:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.856287:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.856294:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.856300:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c840031200 already unused, calling callback (ffffffffc15c6230) 00010000:00010000:2.0:1788925239.856304:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.856312:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.856341:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.856351:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788925239.856384:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875985c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:3307:x1875823947692800:12345-0@lo:103: Request processed in 217us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925239.856391:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788925239.856483:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947692800:0@lo:103: 00010000:00010000:0.0:1788925239.857500:0:5842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.857512:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.857519:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c840031200/0x503aa1a44b68e3cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788925239.857534:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788925239.923252:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:7636:x1875823947691520:12345-0@lo:253: Request processed in 91451us (92111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925239.923278:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788925239.923680:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947691520:0@lo:253: 10000000:01000000:2.0:1788925239.923697:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788925239.923701:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788925239.923703:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788925239.923705:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925239.923706:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788925239.923708:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925239.923710:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925239.923711:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788925239.923713:0:7636:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788925239.923715:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925239.923717:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788925239.923735:0:7636:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98c87ffa4000 from lustre-OST0001 10000000:01000000:2.0:1788925239.923760:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788925239.923762:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788925239.923770:0:7636:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98c844a44d28 local copy 10000000:01000000:2.0:1788925239.923773:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788925239.923809:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.923821:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.923830:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925239.923860:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947692928:0@lo:101: 00000100:00100000:2.0:1788925239.923899:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.924097:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8478f56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925239.924167:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947692928 00000100:00100000:3.0:1788925239.924173:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947692928 00000100:00100000:3.0:1788925239.924249:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788925239.924259:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+11:7636:x1875823947692928:12345-0@lo:101: 00010000:00010000:3.0:1788925239.924282:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925239.924295:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c8821c7000/0x503aa1a44b68e3da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e3d3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925239.924319:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c8821c7000/0x503aa1a44b68e3da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e3d3 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925239.924330:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c8821c7000/0x503aa1a44b68e3da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e3d3 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925239.924345:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8821c7000, rc 0) 00000100:00100000:3.0:1788925239.924383:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:7636:x1875823947692928:12345-0@lo:101: Request processed in 126us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925239.924389:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788925239.924487:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947692928:0@lo:101: 00010000:00010000:2.0:1788925239.924499:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x503aa1a44b68e3da expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.924508:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x503aa1a44b68e3da expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925239.924611:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693056:0@lo:501: 00000100:00100000:2.0:1788925239.924638:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.924864:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8478f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925239.924926:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947693056 00000100:00100000:1.0:1788925239.924931:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947693056 00000100:00100000:1.0:1788925239.924953:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788925239.924959:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:7636:x1875823947693056:12345-0@lo:501: 00000100:00100000:1.0:1788925239.925167:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:7636:x1875823947693056:12345-0@lo:501: Request processed in 207us (527us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788925239.925174:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788925239.925255:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693056:0@lo:501: 10000000:01000000:2.0:1788925239.925280:0:7636:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788925239.925310:0:7636:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788925239.925315:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x503aa1a44b68e3da expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.925324:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x503aa1a44b68e3da expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.925332:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x503aa1a44b68e3da expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.925356:0:7636:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788925239.925386:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98c87ffa4000 10000000:01000000:2.0:1788925239.925391:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788925239.925396:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788925239.925413:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788925239.925418:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788925239.925421:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788925239.925439:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.925445:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.925453:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925239.925464:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693184:0@lo:101: 00000100:00100000:2.0:1788925239.925490:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.925503:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8478f59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925239.925566:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947693184 00000100:00100000:3.0:1788925239.925571:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947693184 00000100:00100000:3.0:1788925239.925675:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788925239.925684:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:7636:x1875823947693184:12345-0@lo:101: 00010000:00010000:3.0:1788925239.925692:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925239.925704:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e3e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e3e1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925239.925720:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e3e1 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925239.925728:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e3e1 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925239.925735:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8821c6400, rc 0) 00000100:00100000:3.0:1788925239.925771:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947693184:12345-0@lo:101: Request processed in 89us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925239.925777:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788925239.925857:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693184:0@lo:101: 00010000:00010000:2.0:1788925239.925868:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e3e8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.925877:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e3e8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925239.925935:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693312:0@lo:501: 00000100:00100000:2.0:1788925239.925963:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.925991:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8478f59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925239.926046:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947693312 00000100:00100000:1.0:1788925239.926050:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947693312 00000100:00100000:1.0:1788925239.926067:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788925239.926072:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947693312:12345-0@lo:501: 00000100:00100000:1.0:1788925239.929629:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947693312:12345-0@lo:501: Request processed in 3543us (3652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925239.929665:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:1.0:1788925239.929728:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925239.929735:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x503aa1a44b68e3da expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.929746:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c85c218a00 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:1.0:1788925239.929750:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x503aa1a44b68e3da expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.929761:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x503aa1a44b68e3da expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925239.929769:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x503aa1a44b68e3da expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925239.929775:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788925239.929813:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x503aa1a44b68e3da expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.929820:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788925239.929856:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x503aa1a44b68e3da expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.929863:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c85c218a00/0x503aa1a44b68e3d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x503aa1a44b68e3da expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.929879:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925239.929881:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925239.929882:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925239.929890:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925239.929913:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947693440:0@lo:103: 00000100:00100000:1.0:1788925239.929964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925239.930014:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947693440 00000100:00100000:1.0:1788925239.930022:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947693440 00000100:00100000:1.0:1788925239.930071:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925239.930080:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875985500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:3306:x1875823947693440:12345-0@lo:103: 00010000:00010000:1.0:1788925239.930092:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925239.930108:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c8821c7000/0x503aa1a44b68e3da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x503aa1a44b68e3d3 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.930122:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925239.930155:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875985500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:3306:x1875823947693440:12345-0@lo:103: Request processed in 76us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925239.930162:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925239.930197:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947693440:0@lo:103: 00000100:00100000:2.0:1788925239.931206:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693312:0@lo:501: 00000100:00100000:2.0:1788925239.931291:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693568:0@lo:503: 00000100:00100000:2.0:1788925239.931351:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925239.931444:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947693568 00000100:00100000:3.0:1788925239.931451:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947693568 00000100:00100000:3.0:1788925239.931488:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788925239.931496:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:7636:x1875823947693568:12345-0@lo:503: 00000100:00100000:2.0:1788925239.931612:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8478f59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925239.931714:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:7636:x1875823947693568:12345-0@lo:503: Request processed in 219us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925239.931729:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788925239.931867:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693568:0@lo:503: 00000040:00080000:2.0:1788925239.932130:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788925239.932187:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693696:0@lo:502: 00000100:00100000:2.0:1788925239.932220:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.932340:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8478f59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925239.932381:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947693696 00000100:00100000:0.0:1788925239.932386:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947693696 00000100:00100000:0.0:1788925239.932438:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788925239.932445:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:7636:x1875823947693696:12345-0@lo:502: 00000100:00100000:0.0:1788925239.932752:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:7636:x1875823947693696:12345-0@lo:502: Request processed in 306us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.932759:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788925239.932896:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693696:0@lo:502: 00000040:00080000:2.0:1788925239.933154:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788925239.933198:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788925239.933225:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788925239.933478:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788925239.933521:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788925239.933554:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788925239.933584:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693824:0@lo:502: 00000100:00100000:2.0:1788925239.933697:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.933774:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8478f59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925239.933887:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947693824 00000100:00100000:0.0:1788925239.933893:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947693824 00000100:00100000:0.0:1788925239.933970:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788925239.933979:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:7636:x1875823947693824:12345-0@lo:502: 00000100:00100000:0.0:1788925239.934142:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:7636:x1875823947693824:12345-0@lo:502: Request processed in 163us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.934149:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788925239.934218:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693824:0@lo:502: 00000040:00080000:2.0:1788925239.934312:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788925239.934322:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788925239.937917:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788925239.937932:0:7646:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788925239.937940:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925239.937942:0:7646:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788925239.937949:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788925239.937966:0:7646:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98c87ff9b370) 00000020:00000080:2.0:1788925239.938008:0:7646:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788925239.938014:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788925239.938100:0:7646:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c87ffa4000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788925239.938109:0:7646:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788925239.938116:0:7646:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x503aa1a44b68e3f6 00010000:00010000:2.0:1788925239.941830:0:7646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788925239.942179:0:7646:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788925239.944488:0:7646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788925239.944932:0:7646:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788925239.948588:0:7646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788925239.949139:0:7646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788925239.952003:0:7646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788925239.952015:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925239.952021:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925239.952023:0:7646:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788925239.952027:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925239.952031:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925239.952032:0:7646:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788925239.952035:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788925239.952037:0:7646:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788925239.952101:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925239.952104:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925239.952105:0:7646:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788925239.952108:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788925239.954513:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788925239.954559:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788925239.954627:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e3e8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925239.954644:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e3e8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925239.954652:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c87ffa4000 from 1 10000000:01000000:3.0:1788925239.954656:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788925239.954711:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925239.954720:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925239.954732:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925239.954759:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693952:0@lo:101: 00000100:00100000:3.0:1788925239.954845:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925239.954890:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8484053c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925239.954991:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947693952 00000100:00100000:1.0:1788925239.955001:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947693952 00000100:00100000:1.0:1788925239.955052:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788925239.955062:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:7636:x1875823947693952:12345-0@lo:101: 00010000:00010000:1.0:1788925239.955078:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925239.955092:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e404 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e3fd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.955118:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e3fd expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.955130:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e3fd expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.955155:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c861867c00, rc 0) 00000100:00100000:1.0:1788925239.955196:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947693952:12345-0@lo:101: Request processed in 135us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925239.955203:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788925239.956969:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947693952:0@lo:101: 00010000:00010000:3.0:1788925239.956996:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e404 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925239.957010:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e404 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925239.957180:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694080:0@lo:501: 00000100:00100000:3.0:1788925239.957242:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925239.957301:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8484053c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925239.961720:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947694080 00000100:00100000:1.0:1788925239.961739:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947694080 00000100:00100000:1.0:1788925239.961824:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788925239.961836:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947694080:12345-0@lo:501: 00000100:00100000:1.0:1788925239.962468:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947694080:12345-0@lo:501: Request processed in 631us (5222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925239.962476:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788925239.962550:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694080:0@lo:501: 00000100:00100000:1.0:1788925239.963173:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875985f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694208:0@lo:503: 00000100:00100000:1.0:1788925239.963229:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925239.963280:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87d1a7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788925239.963338:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947694208 00000100:00100000:3.0:1788925239.963344:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947694208 00000100:00100000:3.0:1788925239.963386:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788925239.963395:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947694208:12345-0@lo:503: 00000100:00100000:3.0:1788925239.963775:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947694208:12345-0@lo:503: Request processed in 380us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925239.963783:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788925239.963954:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875985f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694208:0@lo:503: 00000040:00080000:1.0:1788925239.964308:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788925239.964393:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875985f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694336:0@lo:502: 00000100:00100000:1.0:1788925239.964446:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925239.964470:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87d1a7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788925239.966661:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947694336 00000100:00100000:3.0:1788925239.966681:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947694336 00000100:00100000:3.0:1788925239.966752:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788925239.966764:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947694336:12345-0@lo:502: 00000100:00100000:3.0:1788925239.967075:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947694336:12345-0@lo:502: Request processed in 312us (2628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925239.967083:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788925239.967423:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875985f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694336:0@lo:502: 00000040:00080000:2.0:1788925239.967876:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788925239.967934:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788925239.967972:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694464:0@lo:502: 00000100:00100000:2.0:1788925239.968023:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.969783:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c851c260c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925239.972682:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947694464 00000100:00100000:1.0:1788925239.972700:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947694464 00000100:00100000:1.0:1788925239.972817:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788925239.972829:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947694464:12345-0@lo:502: 00000100:00100000:1.0:1788925239.973175:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947694464:12345-0@lo:502: Request processed in 348us (5150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925239.973194:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788925239.973322:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694464:0@lo:502: 00000040:00080000:2.0:1788925239.973530:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788925239.973546:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788925239.975785:0:7650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925239.975801:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925239.975803:0:7650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788925239.975811:0:7650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c87ffa4000 00000020:00000080:3.0:1788925239.975814:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788925239.975831:0:7650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925239.975834:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925239.975835:0:7650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788925239.975839:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788925239.976143:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788925239.976171:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788925239.976199:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e404 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.976213:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e404 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925239.976351:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788925239.976354:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98c87ffa4000 10000000:01000000:1.0:1788925239.976357:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98c87ffa4000 10000000:01000000:1.0:1788925239.976361:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788925239.976366:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c87ffa4000 from 1 10000000:01000000:1.0:1788925239.976369:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788925239.977038:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.977060:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925239.977075:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925239.977103:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875984700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694592:0@lo:101: 00000100:00100000:0.0:1788925239.977175:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925239.977248:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847f76900 going to sleep for 11 seconds 00000100:00100000:1.0:1788925239.977358:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947694592 00000100:00100000:1.0:1788925239.977367:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947694592 00000100:00100000:1.0:1788925239.977686:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788925239.977697:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947694592:12345-0@lo:101: 00010000:00010000:1.0:1788925239.977714:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925239.977729:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c861867200/0x503aa1a44b68e412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e40b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.977758:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c861867200/0x503aa1a44b68e412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e40b expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.977770:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c861867200/0x503aa1a44b68e412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e40b expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925239.977794:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c861867200, rc 0) 00000100:00100000:1.0:1788925239.977849:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7636:x1875823947694592:12345-0@lo:101: Request processed in 153us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925239.977856:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788925239.978032:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875984700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694592:0@lo:101: 00010000:00010000:2.0:1788925239.978048:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e412 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925239.978058:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e412 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925239.978169:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694720:0@lo:501: 00000100:00100000:2.0:1788925239.978204:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.978282:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c851c260c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925239.978352:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947694720 00000100:00100000:1.0:1788925239.978358:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947694720 00000100:00100000:1.0:1788925239.978700:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788925239.978709:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7636:x1875823947694720:12345-0@lo:501: 00000100:00100000:1.0:1788925239.978949:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7636:x1875823947694720:12345-0@lo:501: Request processed in 240us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925239.978957:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788925239.979025:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694720:0@lo:501: 00000100:00100000:2.0:1788925239.979053:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694848:0@lo:503: 00000100:00100000:2.0:1788925239.979087:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.979262:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c851c260c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925239.979465:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947694848 00000100:00100000:3.0:1788925239.979478:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947694848 00000100:00100000:3.0:1788925239.979511:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788925239.979517:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7636:x1875823947694848:12345-0@lo:503: 00000100:00100000:3.0:1788925239.979696:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7636:x1875823947694848:12345-0@lo:503: Request processed in 178us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925239.979704:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788925239.979924:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694848:0@lo:503: 00000040:00080000:2.0:1788925239.980207:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788925239.980302:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694976:0@lo:502: 00000100:00100000:2.0:1788925239.980345:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.980387:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c851c260c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925239.980642:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947694976 00000100:00100000:3.0:1788925239.980649:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947694976 00000100:00100000:3.0:1788925239.980677:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788925239.980686:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7636:x1875823947694976:12345-0@lo:502: 00000100:00100000:3.0:1788925239.980861:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7636:x1875823947694976:12345-0@lo:502: Request processed in 175us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925239.980868:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788925239.980948:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947694976:0@lo:502: 00000040:00080000:2.0:1788925239.981199:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788925239.981242:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788925239.981338:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788925239.981607:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788925239.981655:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788925239.981718:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788925239.981748:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788925239.981774:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788925239.981810:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788925239.981838:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788925239.981864:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788925239.981901:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788925239.981928:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788925239.981954:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788925239.981990:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788925239.982018:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788925239.982044:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788925239.982092:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788925239.982123:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788925239.982149:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788925239.982186:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788925239.982224:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788925239.982756:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788925239.982837:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788925239.982869:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788925239.982895:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788925239.982944:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788925239.982976:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788925239.983002:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788925239.983041:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788925239.983069:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788925239.983094:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788925239.983120:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788925239.983156:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788925239.983183:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788925239.983220:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788925239.983248:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788925239.983825:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947695104:0@lo:502: 00000100:00100000:3.0:1788925239.983903:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925239.983979:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c848405000 going to sleep for 11 seconds 00000100:00100000:1.0:1788925239.984014:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947695104 00000100:00100000:1.0:1788925239.984021:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947695104 00000100:00100000:1.0:1788925239.984097:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788925239.984105:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7636:x1875823947695104:12345-0@lo:502: 00000100:00100000:1.0:1788925239.984360:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7636:x1875823947695104:12345-0@lo:502: Request processed in 254us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925239.984368:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788925239.984527:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947695104:0@lo:502: 00000040:00080000:3.0:1788925239.984616:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788925239.984630:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788925239.985793:0:7651:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788925239.985808:0:7651:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98c87ff9cd28) 00000020:00000080:2.0:1788925239.985829:0:7651:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788925239.985894:0:7651:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98c87ffa4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788925239.985898:0:7651:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98c87ffa4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788925239.985900:0:7651:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98c87ffa4000 3 00010000:00080000:2.0:1788925239.985926:0:7651:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c877647000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.128@tcp at head 00010000:00010000:3.0:1788925239.988011:0:7651:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788925239.988333:0:7651:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788925239.988368:0:7651:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788925239.988390:0:7651:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x503aa1a44b68e420 00000100:00080000:3.0:1788925239.988428:0:7651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788925239.988434:0:7651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98c877647000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:3.0:1788925239.988465:0:7651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c8482c1180 x1875823947695232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788925239.988685:0:7651:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788925239.988808:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823947695232:0@lo:38: 00000100:00100000:0.0:1788925239.988879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925239.989121:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947695232 00000100:00100000:3.0:1788925239.989129:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947695232 00000100:00100000:3.0:1788925239.989166:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925239.989174:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875823947695232:12345-0@lo:38: 00010000:00080000:3.0:1788925239.989197:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:3.0:1788925239.989231:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x503aa1a44b68e427 00000004:00100000:3.0:1788925239.989247:0:5847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788925239.989298:0:5847:0:(import.c:65:import_set_state_nolock()) ffff98c8514b6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788925239.989345:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823947695232:12345-0@lo:38: Request processed in 170us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925239.989352:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788925239.989602:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c8482c1180 x1875823947695232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788925249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925239.989613:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788925239.989621:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788925239.989629:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788925239.989633:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788925239.989635:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98c877647000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788925239.989641:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823947695232:0@lo:38: 00000040:00080000:0.0:1788925239.989875:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788925239.990002:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788925239.990028:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788925239.990049:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e412 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925239.990060:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e412 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788925239.990104:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788925239.990106:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788925239.990107:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925239.990109:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925239.990110:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925239.990112:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925239.990113:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788925239.990115:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788925239.990116:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788925239.990118:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925239.990122:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788925239.990126:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788925239.990128:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788925239.990130:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788925239.990131:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925239.990132:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925239.990133:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925239.990134:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925239.990135:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788925239.990136:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788925239.990137:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788925239.990138:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925239.990139:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788925239.990154:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788925239.990165:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947695360:0@lo:253: 00000100:00100000:3.0:1788925239.990202:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925239.990223:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c848405f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788925239.990331:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947695360 00000100:00100000:0.0:1788925239.990335:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947695360 00000100:00100000:0.0:1788925239.990365:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788925239.990372:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7636:x1875823947695360:12345-0@lo:253: 20000000:01000000:0.0:1788925239.990431:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788925239.990447:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788925239.991310:0:7652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7652:1875823947695488:0@lo:901: 00000100:00100000:3.0:1788925239.991362:0:7652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925239.991397:0:7652:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8737d5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788925239.991651:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947695488 00000100:00100000:0.0:1788925239.991656:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947695488 00000100:00100000:0.0:1788925239.991708:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788925239.991716:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7652:x1875823947695488:12345-0@lo:901: 00000100:00100000:0.0:1788925239.991994:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7652:x1875823947695488:12345-0@lo:901: Request processed in 278us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.992002:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788925239.992041:0:7652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c8482c0e00 x1875823947695488/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788925255 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925239.992053:0:7652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7652:1875823947695488:0@lo:901: 00000100:00080000:3.0:1788925239.992194:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925239.994648:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925239.994675:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947695616:0@lo:400: 00000100:00100000:3.0:1788925239.994745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925239.996037:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947695616 00000100:00100000:1.0:1788925239.996048:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947695616 00000100:00100000:1.0:1788925239.996103:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788925239.996112:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947695616:12345-0@lo:400: 00000100:00100000:1.0:1788925239.996193:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947695616:12345-0@lo:400: Request processed in 82us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925239.996200:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788925239.996223:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947695744:0@lo:400: 00000100:00100000:3.0:1788925239.996886:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947695872:0@lo:400: 00000100:00100000:3.0:1788925239.996921:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925239.996996:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925239.997048:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947695872 00000100:00100000:0.0:1788925239.997053:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947695872 00000100:00100000:0.0:1788925239.997092:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788925239.997099:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947695872:12345-0@lo:400: 00000100:00100000:0.0:1788925239.997139:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947695872:12345-0@lo:400: Request processed in 41us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.997146:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788925239.997161:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788925239.997186:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c8482c3480 x1875823947695872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925239.997200:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947695872:0@lo:400: 00010000:00080000:1.0:1788925239.997302:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c8482c0380 x1875823947695616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925239.997312:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947695616:0@lo:400: 00000100:00100000:3.0:1788925240.004315:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947695744 00000100:00100000:3.0:1788925240.004337:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947695744 00000100:00100000:3.0:1788925240.004444:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925240.004457:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947695744:12345-0@lo:400: 00000100:00080000:2.0:1788925240.004755:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925240.004848:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947695744:12345-0@lo:400: Request processed in 394us (7851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925240.004869:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788925240.004926:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c8482c1880 x1875823947695744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925240.004942:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947695744:0@lo:400: 20000000:01000000:3.0:1788925240.036025:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788925240.036053:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788925240.036068:0:5863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788925240.036074:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788925240.036108:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925240.036133:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e378 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925240.036143:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925240.036206:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e378 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925240.036228:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e37f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e378 expref: 14 pid: 5840 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925240.036249:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875985f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1875823947696000:0@lo:104: 00000100:00100000:1.0:1788925240.036351:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925240.036442:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87d1a7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788925240.036518:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947696000 00000100:00100000:3.0:1788925240.036528:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947696000 00000100:00100000:1.0:1788925240.036809:0:7643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788925240.036826:0:7643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875987800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:5863:x1875823947696000:12345-0@lo:104: 00010000:00010000:1.0:1788925240.036845:0:7643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e37f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925240.036940:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788925240.036948:0:7643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875987800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:5863:x1875823947696000:12345-0@lo:104: Request processed in 126us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925240.036956:0:7643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788925240.037010:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875985f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1875823947696000:0@lo:104: 00010000:00010000:1.0:1788925240.037037:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925240.037243:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925240.038185:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e37f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925240.038198:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8821c6a00 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:0.0:1788925240.038211:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e37f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925240.038220:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e37f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925240.038228:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e37f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925240.038235:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925240.038339:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e37f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925240.038346:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925240.038390:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e37f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925240.038397:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c8821c6a00/0x503aa1a44b68e378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e37f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925240.038428:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925240.038430:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925240.038432:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925240.038439:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925240.038457:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947696128:0@lo:103: 00000100:00100000:0.0:1788925240.038527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925240.038758:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947696128 00000100:00100000:3.0:1788925240.038766:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947696128 00010000:00010000:3.0:1788925240.038800:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e37f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e378 expref: 15 pid: 5840 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925240.038845:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788925240.038854:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844a03c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:3306:x1875823947696128:12345-0@lo:103: 00010000:00010000:3.0:1788925240.038869:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925240.038875:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e37f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e378 expref: 15 pid: 5840 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.038891:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e378 expref: 15 pid: 5840 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.038908:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e37f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e378 expref: 15 pid: 5840 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.038924:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.038932:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788925240.038959:0:5833:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002886071s 00010000:00010000:3.0:1788925240.038964:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.038970:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.038977:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.038983:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.038989:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861867400 already unused, calling callback (ffffffffc15c6230) 00010000:00010000:3.0:1788925240.038993:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.039000:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.039016:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.039025:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925240.039062:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844a03c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:3306:x1875823947696128:12345-0@lo:103: Request processed in 209us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925240.039069:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788925240.039126:0:5863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.039144:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925240.039151:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c861867400/0x503aa1a44b68e42e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925240.039846:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947696128:0@lo:103: 00000100:00100000:1.0:1788925240.044350:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:7636:x1875823947695360:12345-0@lo:253: Request processed in 53965us (54134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925240.044367:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788925240.044535:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7636:1875823947695360:0@lo:253: 10000000:01000000:2.0:1788925240.044553:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788925240.044556:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788925240.044557:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788925240.044559:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925240.044560:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788925240.044561:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925240.044562:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925240.044564:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788925240.044565:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788925240.044567:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788925240.044568:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925240.044570:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788925240.044603:0:7636:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788925240.048847:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788925240.049038:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788925240.049245:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788925240.049732:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788925240.049928:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788925240.050159:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788925240.054944:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1788925240.162181:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788925240.322054:0:7636:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788925240.322063:0:7636:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788925240.322095:0:7636:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788925240.322164:0:7636:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788925240.322182:0:7636:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788925240.322213:0:7636:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788925241.180860:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925242.200688:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925242.777834:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947696256:0@lo:13: 00000100:00100000:0.0:1788925242.777912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925242.777996:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947696256 00000100:00100000:0.0:1788925242.778015:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947696256 00000100:00100000:0.0:1788925242.778068:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788925242.778076:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947696256:12345-0@lo:13: 00002000:00000024:0.0:1788925242.778116:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925242.778161:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947696256:12345-0@lo:13: Request processed in 85us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925242.778168:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788925242.778188:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788925242.778214:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe5f80 x1875823947696256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925242.778248:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947696256:0@lo:13: 00010000:00010000:1.0:1788925243.223517:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925244.254857:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925245.270726:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925245.335427:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947696512:0@lo:400: 00000100:00100000:0.0:1788925245.335523:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925245.335592:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788925245.335598:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947696384:0@lo:400: 00000100:00100000:0.0:1788925245.335630:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925245.335802:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947696512 00000100:00100000:2.0:1788925245.335815:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947696512 00000100:00100000:2.0:1788925245.335865:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788925245.335875:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947696512:12345-0@lo:400: 00000100:00100000:2.0:1788925245.335936:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947696512:12345-0@lo:400: Request processed in 60us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925245.335960:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788925245.344917:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947696896:0@lo:400: 00000100:00100000:0.0:1788925245.345012:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788925245.345076:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe5180 x1875823947696512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925245.345094:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947696512:0@lo:400: 00000100:00100000:0.0:1788925245.345144:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947696640:0@lo:400: 00000100:00100000:0.0:1788925245.345182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925245.345216:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788925245.345243:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947696768:0@lo:400: 00000100:00100000:0.0:1788925245.345279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925245.345322:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947696768 00000100:00100000:0.0:1788925245.345330:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947696768 00000100:00100000:0.0:1788925245.345421:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788925245.345432:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947696768:12345-0@lo:400: 00000100:00100000:0.0:1788925245.345492:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947696768:12345-0@lo:400: Request processed in 61us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925245.345499:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788925245.345524:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788925245.345555:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe7800 x1875823947696768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925245.345567:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947696768:0@lo:400: 00000100:00100000:0.0:1788925245.345590:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947696896 00000100:00100000:0.0:1788925245.345593:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947696896 00000100:00100000:0.0:1788925245.345622:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947696640 00000100:00100000:0.0:1788925245.345625:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947696640 00000100:00100000:0.0:1788925245.345636:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788925245.345642:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947696896:12345-0@lo:400: 00000100:00100000:0.0:1788925245.345679:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947696896:12345-0@lo:400: Request processed in 37us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925245.345685:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788925245.345695:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788925245.345700:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947696640:12345-0@lo:400: 00000100:00100000:0.0:1788925245.345724:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947696640:12345-0@lo:400: Request processed in 24us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925245.345730:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788925245.345749:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788925245.345762:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe6a00 x1875823947696640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925245.345772:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947696640:0@lo:400: 00010000:00080000:0.0:1788925245.345793:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe6300 x1875823947696896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925245.345802:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947696896:0@lo:400: 00000100:00100000:0.0:1788925245.345836:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947696384 00000100:00100000:0.0:1788925245.345840:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947696384 00000100:00100000:0.0:1788925245.345863:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788925245.345869:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:3308:x1875823947696384:12345-0@lo:400: 00000100:00100000:0.0:1788925245.345900:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:3308:x1875823947696384:12345-0@lo:400: Request processed in 31us (10269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925245.345906:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788925245.345941:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947696384:0@lo:400: 00010000:00010000:2.0:1788925246.295759:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925247.318842:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925247.896588:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925247.896615:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947697024:0@lo:13: 00000100:00100000:3.0:1788925247.896687:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925247.897936:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947697024 00000100:00100000:0.0:1788925247.897954:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947697024 00000100:00100000:0.0:1788925247.898054:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788925247.898068:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947697024:12345-0@lo:13: 10000000:01000000:2.0:1788925247.898099:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788925247.898107:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c87599a800 from 30 10000000:01000000:2.0:1788925247.898111:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00002000:00000024:0.0:1788925247.898121:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00010000:2.0:1788925247.898173:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.898188:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.898200:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925247.898226:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947697152:0@lo:101: 00000100:00100000:0.0:1788925247.898236:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947697024:12345-0@lo:13: Request processed in 170us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.898246:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925247.898287:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788925247.898301:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788925247.898333:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c84a09e180 going to sleep for 11 seconds 00010000:00080000:0.0:1788925247.898365:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482c1880 x1875823947697024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925247.898391:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947697152 00000100:00100000:2.0:1788925247.898397:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947697152 00000100:00100000:0.0:1788925247.898429:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947697024:0@lo:13: 00000100:00100000:2.0:1788925247.898457:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788925247.898465:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947697152:12345-0@lo:101: 00010000:00010000:2.0:1788925247.898477:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925247.898495:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c85c219400/0x503aa1a44b68e43c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e435 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.898528:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c85c219400/0x503aa1a44b68e43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e435 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.898539:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c85c219400/0x503aa1a44b68e43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e435 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.898555:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c85c219400, rc 0) 00000100:00100000:2.0:1788925247.898595:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947697152:12345-0@lo:101: Request processed in 131us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.898601:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788925247.903170:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947697152:0@lo:101: 00010000:00010000:0.0:1788925247.903217:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e43c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.903233:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e43c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925247.903370:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947697280:0@lo:501: 00000100:00100000:0.0:1788925247.903498:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925247.903560:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab780 going to sleep for 11 seconds 00000100:00100000:2.0:1788925247.904293:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947697280 00000100:00100000:2.0:1788925247.904306:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947697280 00000100:00100000:2.0:1788925247.904390:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788925247.904418:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947697280:12345-0@lo:501: 00000100:00100000:2.0:1788925247.904938:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947697280:12345-0@lo:501: Request processed in 535us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.904947:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788925247.908057:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947697280:0@lo:501: 00000100:00100000:0.0:1788925247.908166:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947697408:0@lo:503: 00000100:00100000:0.0:1788925247.908275:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925247.908329:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab780 going to sleep for 11 seconds 00000100:00100000:0.0:1788925247.908357:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947697408 00000100:00100000:0.0:1788925247.908365:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947697408 00000100:00100000:0.0:1788925247.908435:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788925247.909834:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947697408:12345-0@lo:503: 00000100:00100000:0.0:1788925247.912548:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947697408:12345-0@lo:503: Request processed in 2789us (4259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.912572:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788925247.916590:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947697408:0@lo:503: 00000100:00100000:2.0:1788925247.916957:0:7953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7953:1875823947697536:0@lo:502: 00000100:00100000:2.0:1788925247.917060:0:7953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.917109:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947697536 00000100:00100000:2.0:1788925247.917116:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947697536 00000100:00100000:2.0:1788925247.917178:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788925247.917190:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7953:x1875823947697536:12345-0@lo:502: 00000100:00100000:2.0:1788925247.917637:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7953:x1875823947697536:12345-0@lo:502: Request processed in 446us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.917647:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788925247.917719:0:7953:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c862fd1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788925247.917756:0:7953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7953:1875823947697536:0@lo:502: 00000100:00100000:2.0:1788925247.917813:0:7953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7953:1875823947697664:0@lo:502: 00000100:00100000:2.0:1788925247.917864:0:7953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.917883:0:7953:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c862fd1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788925247.918158:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947697664 00000100:00100000:0.0:1788925247.918164:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947697664 00000100:00100000:0.0:1788925247.918207:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788925247.918225:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7953:x1875823947697664:12345-0@lo:502: 00000100:00100000:0.0:1788925247.918493:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:7953:x1875823947697664:12345-0@lo:502: Request processed in 269us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.918504:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788925247.918665:0:7953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7953:1875823947697664:0@lo:502: 00000040:00080000:3.0:1788925247.918709:0:7953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788925247.918817:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788925247.918852:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788925247.918865:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e43c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.918891:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e43c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925247.918903:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788925247.918907:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788925247.918911:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788925247.918948:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.918958:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.918969:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925247.918988:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947697792:0@lo:101: 00000100:00100000:0.0:1788925247.919028:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925247.919059:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430abcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925247.919076:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947697792 00000100:00100000:0.0:1788925247.919081:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947697792 00000100:00100000:0.0:1788925247.919115:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788925247.919122:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947697792:12345-0@lo:101: 00010000:00010000:0.0:1788925247.919144:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925247.919159:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c840031000/0x503aa1a44b68e44a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e443 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.919185:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c840031000/0x503aa1a44b68e44a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e443 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.919197:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c840031000/0x503aa1a44b68e44a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e443 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.919208:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c840031000, rc 0) 00000100:00100000:0.0:1788925247.919241:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947697792:12345-0@lo:101: Request processed in 118us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.919248:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788925247.919281:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947697792:0@lo:101: 00010000:00010000:0.0:1788925247.919294:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e44a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.919305:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e44a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925247.919353:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947697920:0@lo:501: 00000100:00100000:0.0:1788925247.919379:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925247.919391:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430abcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925247.919424:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947697920 00000100:00100000:0.0:1788925247.919428:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947697920 00000100:00100000:0.0:1788925247.919445:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788925247.919458:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947697920:12345-0@lo:501: 00000100:00100000:0.0:1788925247.919919:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947697920:12345-0@lo:501: Request processed in 460us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.919927:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788925247.920082:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947697920:0@lo:501: 00000100:00100000:2.0:1788925247.920206:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947698048:0@lo:503: 00000100:00100000:2.0:1788925247.920271:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.920307:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c862fd1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788925247.920323:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947698048 00000100:00100000:0.0:1788925247.920329:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947698048 00000100:00100000:0.0:1788925247.920363:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788925247.920372:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947698048:12345-0@lo:503: 00000100:00100000:0.0:1788925247.920900:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947698048:12345-0@lo:503: Request processed in 527us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.920909:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788925247.920940:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947698048:0@lo:503: 00000100:00100000:0.0:1788925247.921573:0:7954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7954:1875823947698176:0@lo:502: 00000100:00100000:0.0:1788925247.921642:0:7954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925247.921682:0:7954:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925247.921916:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947698176 00000100:00100000:2.0:1788925247.921923:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947698176 00000100:00100000:2.0:1788925247.922009:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788925247.922020:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:7954:x1875823947698176:12345-0@lo:502: 00000100:00100000:2.0:1788925247.922593:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:7954:x1875823947698176:12345-0@lo:502: Request processed in 572us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.922603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788925247.923215:0:7954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7954:1875823947698176:0@lo:502: 00000020:01000000:0.0:1788925247.923260:0:7954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925247.923272:0:7954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925247.923275:0:7954:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788925247.923281:0:7954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788925247.923283:0:7954:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788925247.923318:0:7954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7954:1875823947698304:0@lo:502: 00000100:00100000:0.0:1788925247.923376:0:7954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925247.923503:0:7954:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925247.924677:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947698304 00000100:00100000:2.0:1788925247.924697:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947698304 00000100:00100000:2.0:1788925247.924779:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788925247.924792:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:7954:x1875823947698304:12345-0@lo:502: 00000100:00100000:2.0:1788925247.925179:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:7954:x1875823947698304:12345-0@lo:502: Request processed in 388us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.925188:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788925247.925297:0:7954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7954:1875823947698304:0@lo:502: 00000020:01000000:0.0:1788925247.925339:0:7954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925247.925349:0:7954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925247.925351:0:7954:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788925247.925375:0:7954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788925247.925505:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788925247.925527:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788925247.925539:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e44a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.925563:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e44a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925247.925576:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788925247.925579:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c844c1e800 from 30 10000000:01000000:2.0:1788925247.925583:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788925247.925621:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.925630:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.925640:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925247.925662:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947698432:0@lo:101: 00000100:00100000:2.0:1788925247.925704:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.925747:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c862fd16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925247.925782:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947698432 00000100:00100000:0.0:1788925247.925788:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947698432 00000100:00100000:0.0:1788925247.925826:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788925247.925834:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947698432:12345-0@lo:101: 00010000:00010000:0.0:1788925247.925845:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925247.925860:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c840031c00/0x503aa1a44b68e458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e451 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.925886:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c840031c00/0x503aa1a44b68e458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e451 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.925898:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c840031c00/0x503aa1a44b68e458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e451 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.925907:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c840031c00, rc 0) 00000100:00100000:0.0:1788925247.925943:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947698432:12345-0@lo:101: Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.925949:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788925247.926300:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947698432:0@lo:101: 00010000:00010000:2.0:1788925247.926318:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e458 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.926328:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e458 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925247.926387:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947698560:0@lo:501: 00000100:00100000:2.0:1788925247.926454:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.926491:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c862fd16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925247.926780:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947698560 00000100:00100000:0.0:1788925247.926787:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947698560 00000100:00100000:0.0:1788925247.926832:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788925247.926840:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947698560:12345-0@lo:501: 00000100:00100000:0.0:1788925247.927192:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947698560:12345-0@lo:501: Request processed in 352us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.927201:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788925247.928991:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947698560:0@lo:501: 00000100:00100000:2.0:1788925247.929161:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947698688:0@lo:503: 00000100:00100000:2.0:1788925247.929497:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.929567:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c862fd16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925247.931966:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947698688 00000100:00100000:0.0:1788925247.931989:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947698688 00000100:00100000:0.0:1788925247.932092:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788925247.932663:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947698688:12345-0@lo:503: 00000100:00100000:0.0:1788925247.933029:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947698688:12345-0@lo:503: Request processed in 906us (3531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.933038:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788925247.933318:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947698688:0@lo:503: 00000100:00100000:2.0:1788925247.934737:0:7955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7955:1875823947698816:0@lo:502: 00000100:00100000:2.0:1788925247.934848:0:7955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.934907:0:7955:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c874e0f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925247.934993:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947698816 00000100:00100000:0.0:1788925247.935002:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947698816 00000100:00100000:0.0:1788925247.935059:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788925247.935522:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:7955:x1875823947698816:12345-0@lo:502: 00000100:00100000:0.0:1788925247.935839:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:7955:x1875823947698816:12345-0@lo:502: Request processed in 768us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.935849:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788925247.935947:0:7955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7955:1875823947698816:0@lo:502: 00000100:00100000:2.0:1788925247.936019:0:7955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7955:1875823947698944:0@lo:502: 00000100:00100000:2.0:1788925247.936063:0:7955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.936191:0:7955:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c874e0f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925247.936799:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947698944 00000100:00100000:0.0:1788925247.936812:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947698944 00000100:00100000:0.0:1788925247.936862:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788925247.936872:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:7955:x1875823947698944:12345-0@lo:502: 00000100:00100000:0.0:1788925247.937212:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:7955:x1875823947698944:12345-0@lo:502: Request processed in 339us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.937219:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788925247.938957:0:7955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7955:1875823947698944:0@lo:502: 00000040:00080000:2.0:1788925247.939018:0:7955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788925247.939149:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788925247.939180:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788925247.939194:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e458 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.939207:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e458 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925247.939218:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788925247.939233:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98c844c1e800 from 5 10000000:01000000:0.0:1788925247.939236:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788925247.939289:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.939298:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.939308:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925247.939333:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947699072:0@lo:101: 00000100:00100000:0.0:1788925247.939421:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.939466:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947699072 00000100:00100000:2.0:1788925247.939475:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947699072 00000100:00100000:2.0:1788925247.939525:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788925247.939532:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1788925247.939536:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947699072:12345-0@lo:101: 00010000:00010000:2.0:1788925247.939550:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925247.939566:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c85c218c00/0x503aa1a44b68e466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e45f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.939594:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c85c218c00/0x503aa1a44b68e466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e45f expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.939618:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c85c218c00/0x503aa1a44b68e466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e45f expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.939628:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c85c218c00, rc 0) 00000100:00100000:2.0:1788925247.939672:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947699072:12345-0@lo:101: Request processed in 136us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.939679:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788925247.939727:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947699072:0@lo:101: 00010000:00010000:2.0:1788925247.939740:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e45f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e466 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.939750:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e45f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e466 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925247.939798:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947699200:0@lo:256: 00000100:00100000:2.0:1788925247.939832:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.939847:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c874e0f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788925247.939861:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947699200 00000100:00100000:2.0:1788925247.939865:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947699200 00000100:00100000:2.0:1788925247.939888:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788925247.939894:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947699200:12345-0@lo:256: 20000000:01000000:2.0:1788925247.939910:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788925247.939930:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788925247.939934:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788925247.940032:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947699200:12345-0@lo:256: Request processed in 137us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.940039:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788925247.940290:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947699200:0@lo:256: 10000000:01000000:0.0:1788925247.940345:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788925247.940353:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e45f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e466 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.940360:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c840030600/0x503aa1a44b68e45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e466 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925247.940367:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788925247.940370:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788925247.940373:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788925247.940392:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.940454:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925247.940482:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925247.940495:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947699328:0@lo:101: 00000100:00100000:0.0:1788925247.940526:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925247.940549:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925247.941140:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947699328 00000100:00100000:2.0:1788925247.941148:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947699328 00000100:00100000:2.0:1788925247.941234:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788925247.941244:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947699328:12345-0@lo:101: 00010000:00010000:2.0:1788925247.941256:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925247.941271:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c85c218800/0x503aa1a44b68e474 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e46d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.941298:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c85c218800/0x503aa1a44b68e474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e46d expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.941309:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c85c218800/0x503aa1a44b68e474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e46d expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.941316:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c85c218800, rc 0) 00000100:00100000:2.0:1788925247.941363:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947699328:12345-0@lo:101: Request processed in 121us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.941369:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788925247.941547:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947699328:0@lo:101: 00010000:00010000:2.0:1788925247.941567:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.941577:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925247.941721:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947699456:0@lo:501: 00000100:00100000:2.0:1788925247.941752:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.941830:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c874e0fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788925247.941919:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947699456 00000100:00100000:0.0:1788925247.941926:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947699456 00000100:00100000:0.0:1788925247.942003:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788925247.942012:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947699456:12345-0@lo:501: 00000100:00100000:0.0:1788925247.942494:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947699456:12345-0@lo:501: Request processed in 482us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.942502:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788925247.942581:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947699456:0@lo:501: 00000100:00100000:2.0:1788925247.942644:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947699584:0@lo:503: 00000100:00100000:2.0:1788925247.942692:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.942709:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c874e0fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788925247.942724:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947699584 00000100:00100000:2.0:1788925247.942729:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947699584 00000100:00100000:2.0:1788925247.942754:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788925247.942761:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947699584:12345-0@lo:503: 00000100:00100000:2.0:1788925247.943091:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947699584:12345-0@lo:503: Request processed in 330us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.943287:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788925247.943369:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947699584:0@lo:503: 00000100:00100000:3.0:1788925247.946041:0:7956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7956:1875823947699712:0@lo:502: 00000100:00100000:0.0:1788925247.947200:0:7956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925247.947369:0:7956:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8759c8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788925247.947701:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947699712 00000100:00100000:3.0:1788925247.947717:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947699712 00000100:00100000:3.0:1788925247.947836:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788925247.947850:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:7956:x1875823947699712:12345-0@lo:502: 00000100:00100000:3.0:1788925247.948594:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:7956:x1875823947699712:12345-0@lo:502: Request processed in 743us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925247.948606:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788925247.948916:0:7956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7956:1875823947699712:0@lo:502: 00000020:01000000:0.0:1788925247.948970:0:7956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788925247.948981:0:7956:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788925247.948990:0:7956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925247.948993:0:7956:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788925247.949001:0:7956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788925247.949006:0:7956:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.128@tcp to nid 0x20000c0a8cc80 (192.168.204.128@tcp) 00000020:01000000:0.0:1788925247.949039:0:7956:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788925247.949043:0:7956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788925247.949063:0:7956:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98c844a43370) 00000020:00000080:0.0:1788925247.949163:0:7956:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788925247.949172:0:7956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788925247.949366:0:7956:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788925247.949373:0:7956:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788925247.949383:0:7956:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x503aa1a44b68e482 00010000:00080000:0.0:1788925247.949439:0:7956:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c86e776800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:0.0:1788925247.949961:0:7956:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788925247.950859:0:7956:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788925247.950883:0:7956:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788925247.951657:0:7956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788925247.951900:0:7956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788925247.951956:0:7956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788925247.952013:0:7956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788925247.954902:0:7957:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788925247.954917:0:7957:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788925247.956928:0:7956:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788925247.956947:0:7956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788925247.956995:0:7956:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788925247.957023:0:7956:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x503aa1a44b68e489 00000100:00080000:0.0:1788925247.957035:0:7956:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788925247.957041:0:7956:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c86e776800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1788925247.957161:0:7956:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c862fe4a80 x1875823947699840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788925247.957203:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875823947699840:0@lo:8: 00000100:00100000:0.0:1788925247.957526:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788925247.957599:0:7956:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788925247.957673:0:7956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925247.957677:0:7956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925247.957679:0:7956:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788925247.957682:0:7956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925247.957686:0:7956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925247.957688:0:7956:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788925247.957697:0:7956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788925247.957699:0:7956:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788925247.957729:0:7956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7956:1875823947699968:0@lo:502: 00000100:00100000:1.0:1788925247.957776:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947699840 00000100:00100000:0.0:1788925247.957781:0:7956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925247.957793:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947699840 00000100:00100000:0.0:1788925247.957814:0:7956:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab780 going to sleep for 11 seconds 00000100:00100000:2.0:1788925247.957838:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947699968 00000100:00100000:2.0:1788925247.957844:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947699968 00000100:00100000:2.0:1788925247.957912:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788925247.957922:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:7956:x1875823947699968:12345-0@lo:502: 00000100:00100000:3.0:1788925247.958146:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823947700224:0@lo:400: 00000100:00100000:3.0:1788925247.958191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925247.958214:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925247.958219:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947700096:0@lo:400: 00000100:00100000:2.0:1788925247.958451:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:7956:x1875823947699968:12345-0@lo:502: Request processed in 527us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.958463:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788925247.958593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925247.958612:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788925247.958623:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1875823947699840:12345-0@lo:8: 00000100:00100000:3.0:1788925247.958639:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947700352:0@lo:400: 00010000:00080000:1.0:1788925247.958652:0:6702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000100:00100000:3.0:1788925247.958673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788925247.958687:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x503aa1a44b68e490 00002000:00100000:1.0:1788925247.958705:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98c85819d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788925247.958710:0:6702:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788925247.958714:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788925247.958722:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947700224 00000100:00100000:3.0:1788925247.958730:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947700224 00000100:00100000:3.0:1788925247.958786:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947700096 00000100:00100000:3.0:1788925247.958790:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947700096 00000100:00100000:3.0:1788925247.958813:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947700352 00000100:00100000:3.0:1788925247.958816:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947700352 00000100:00100000:3.0:1788925247.958845:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788925247.958858:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823947700224:12345-0@lo:400: 00002000:00100000:1.0:1788925247.958878:0:6702:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788925247.959003:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823947700224:12345-0@lo:400: Request processed in 149us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925247.959011:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788925247.959029:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788925247.959036:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947700096:12345-0@lo:400: 00000100:00100000:3.0:1788925247.959064:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947700096:12345-0@lo:400: Request processed in 28us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.959193:0:7956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:7956:1875823947699968:0@lo:502: 00000020:01000000:0.0:1788925247.959523:0:7956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925247.959532:0:7956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925247.959534:0:7956:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788925247.959539:0:7956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1788925247.959772:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788925247.959792:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788925247.959817:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947700352:12345-0@lo:400: 00000100:00100000:3.0:1788925247.959881:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947700352:12345-0@lo:400: Request processed in 68us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925247.959887:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788925247.959926:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788925247.959962:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482c1c00 x1875823947700096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925247.959977:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947700096:0@lo:400: 00010000:00080000:3.0:1788925247.959993:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482c0000 x1875823947700224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925247.960001:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823947700224:0@lo:400: 00002000:00080000:1.0:1788925247.960532:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788925247.960568:0:6702:0:(import.c:65:import_set_state_nolock()) ffff98c858198000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925247.960657:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875823947699840:12345-0@lo:8: Request processed in 2035us (3132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925247.960681:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788925247.960748:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe4a80 x1875823947699840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788925257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925247.960761:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788925247.960769:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788925247.960777:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788925247.960781:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788925247.960783:0:3304:0:(import.c:65:import_set_state_nolock()) ffff98c86e776800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788925247.960795:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788925247.960800:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875823947699840:0@lo:8: 00010000:00080000:0.0:1788925247.961997:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482c1880 x1875823947700352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925247.962015:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947700352:0@lo:400: 00000004:00080000:0.0:1788925247.962061:0:7957:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:2.0:1788925247.962237:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788925247.962286:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788925247.962299:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788925247.962300:0:7957:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 237090897917ns, next at 0ns, rc = 0 00010000:00010000:2.0:1788925247.962318:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925247.962331:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788925247.962348:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98c844a44d28 from 1 10000000:01000000:2.0:1788925247.962351:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788925247.962388:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.962397:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.962427:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925247.962451:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947700480:0@lo:101: 00000100:00100000:2.0:1788925247.962525:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925247.962577:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947700480 00000100:00100000:2.0:1788925247.962578:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c868a40c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788925247.962589:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947700480 00000100:00100000:3.0:1788925247.962846:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788925247.962862:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947700480:12345-0@lo:101: 00010000:00010000:3.0:1788925247.962881:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925247.962903:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e49e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925247.962937:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e497 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925247.962950:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e497 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925247.962961:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8821c7e00, rc 0) 00000100:00100000:3.0:1788925247.963040:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947700480:12345-0@lo:101: Request processed in 182us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925247.963063:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788925247.963236:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947700480:0@lo:101: 00010000:00010000:2.0:1788925247.963255:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e49e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.963266:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e49e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925247.963323:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947700608:0@lo:501: 00000100:00100000:2.0:1788925247.963364:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.963388:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c868a40c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788925247.963449:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947700608 00000100:00100000:0.0:1788925247.963457:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947700608 00000100:00100000:0.0:1788925247.963494:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788925247.963502:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947700608:12345-0@lo:501: 00000100:00100000:0.0:1788925247.963883:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947700608:12345-0@lo:501: Request processed in 380us (517us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788925247.963891:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788925247.963992:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947700608:0@lo:501: 10000000:01000000:2.0:1788925247.964022:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788925247.964029:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e49e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925247.964049:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e49e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788925248.044077:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788925248.044262:0:7958:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788925248.044292:0:7958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875823947700864:0@lo:7: 00000100:00100000:0.0:1788925248.044317:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947700736:0@lo:13: 00000100:00100000:3.0:1788925248.044431:0:7958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925248.044467:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925248.046211:0:7958:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8629a2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788925248.046249:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947700864 00000100:00100000:3.0:1788925248.046257:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947700864 00000100:00100000:3.0:1788925248.046332:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788925248.046342:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7958:x1875823947700864:12345-0@lo:7: 00000100:00100000:0.0:1788925248.047253:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947700736 00000100:00100000:0.0:1788925248.047267:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947700736 00000100:00100000:0.0:1788925248.047345:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788925248.047360:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875823947700736:12345-0@lo:13: 00002000:00000024:0.0:1788925248.048070:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788925248.048205:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875823947700736:12345-0@lo:13: Request processed in 847us (3736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925248.048214:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788925248.048309:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482c0000 x1875823947700736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925248.048341:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947700736:0@lo:13: 00000100:00080000:1.0:1788925248.049385:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788925248.060245:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788925248.060256:0:6699:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788925248.060379:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7958:x1875823947700864:12345-0@lo:7: Request processed in 14033us (15976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925248.060391:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788925248.060857:0:7958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482c1c00 x1875823947700864/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788925264 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925248.060873:0:7958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875823947700864:0@lo:7: 00000004:00080000:3.0:1788925248.060892:0:7958:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788925248.060937:0:7958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875823947700992:0@lo:5: 00000100:00100000:3.0:1788925248.060972:0:7958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925248.061022:0:7958:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c844ba2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788925248.061041:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947700992 00000100:00100000:3.0:1788925248.061047:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947700992 00000100:00100000:3.0:1788925248.061165:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788925248.061175:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7958:x1875823947700992:12345-0@lo:5: 00002000:00080000:3.0:1788925248.061201:0:6699:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788925248.061213:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788925248.062325:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7958:x1875823947700992:12345-0@lo:5: Request processed in 1151us (1350us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788925248.062334:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788925248.067338:0:7958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482c1c00 x1875823947700992/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788925264 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925248.067381:0:7958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875823947700992:0@lo:5: 00000004:00080000:1.0:1788925248.067435:0:7958:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788925248.067486:0:7958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875985f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875823947701120:0@lo:700: 00000100:00100000:1.0:1788925248.067557:0:7958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925248.067610:0:7958:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c743795240 going to sleep for 11 seconds 00000100:00100000:1.0:1788925248.067633:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947701120 00000100:00100000:1.0:1788925248.067638:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947701120 00000100:00100000:1.0:1788925248.067691:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925248.067701:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7958:x1875823947701120:12345-0@lo:700: 00000100:00100000:1.0:1788925248.067739:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875984380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6708:1875823947701248:0@lo:700: 00000100:00100000:1.0:1788925248.067770:0:6708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925248.067807:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c743795f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788925248.067827:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947701248 00000100:00100000:1.0:1788925248.067832:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947701248 00000100:00100000:1.0:1788925248.067866:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925248.067873:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6708:x1875823947701248:12345-0@lo:700: 40000000:02000000:1.0:1788925248.145060:0:5854:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788925248.163247:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6708:x1875823947701248:12345-0@lo:700: Request processed in 95361us (95461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925248.163269:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788925248.163836:0:6708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c875984380 x1875823947701248/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788925264 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925248.163860:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875984380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6708:1875823947701248:0@lo:700: 40000000:02000000:3.0:1788925248.163876:0:6708:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:3.0:1788925248.324228:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788925248.324263:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1788925248.324773:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7958:x1875823947701120:12345-0@lo:700: Request processed in 257067us (257211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925248.324789:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788925248.324962:0:7958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c875985f80 x1875823947701120/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788925264 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925248.324976:0:7958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788925248.325003:0:7958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875985f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875823947701120:0@lo:700: 00010000:00010000:2.0:1788925248.342918:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:1.0:1788925248.416756:0:7958:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788925248.437519:0:7958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875985f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875823947701376:0@lo:5: 00000100:00100000:1.0:1788925248.437624:0:7958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925248.437704:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947701376 00000100:00100000:1.0:1788925248.437714:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947701376 00000100:00100000:1.0:1788925248.437783:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788925248.437795:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7958:x1875823947701376:12345-0@lo:5: 00000100:00100000:2.0:1788925248.440887:0:7958:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c743795cc0 going to sleep for 11 seconds 00002000:00080000:1.0:1788925248.465393:0:6701:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788925248.465693:0:6701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788925248.478574:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7958:x1875823947701376:12345-0@lo:5: Request processed in 40766us (40935us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788925248.478593:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788925248.482933:0:7958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c875985f80 x1875823947701376/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788925264 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925248.482963:0:7958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875985f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875823947701376:0@lo:5: 00000004:00080000:1.0:1788925248.482985:0:7958:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:3.0:1788925248.982658:0:8000:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788925249.368569:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925250.392590:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925251.417934:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925252.438702:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925253.015601:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947701888:0@lo:400: 00000100:00100000:0.0:1788925253.015677:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925253.015759:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947701632:0@lo:400: 00000100:00100000:0.0:1788925253.015763:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788925253.015768:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875823947701760:0@lo:400: 00000100:00100000:0.0:1788925253.015813:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925253.015836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925253.015851:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947701760 00000100:00100000:2.0:1788925253.015852:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947702144:0@lo:400: 00000100:00100000:0.0:1788925253.015858:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947701760 00000100:00100000:2.0:1788925253.015875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925253.015909:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947701632 00000100:00100000:2.0:1788925253.015913:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788925253.015913:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947701632 00000100:00100000:2.0:1788925253.015918:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947701504:0@lo:400: 00000100:00100000:0.0:1788925253.015930:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788925253.015938:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875823947701760:12345-0@lo:400: 00000100:00100000:2.0:1788925253.015945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925253.015962:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947702016:0@lo:400: 00000100:00100000:2.0:1788925253.015981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925253.015988:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875823947701760:12345-0@lo:400: Request processed in 51us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925253.015997:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788925253.016015:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788925253.016021:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947701632:12345-0@lo:400: 00000100:00100000:0.0:1788925253.016071:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947701632:12345-0@lo:400: Request processed in 50us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925253.016077:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788925253.016086:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947702016 00010000:00080000:2.0:1788925253.016088:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe7480 x1875823947701632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925253.016100:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947702016 00000100:00100000:2.0:1788925253.016102:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947701632:0@lo:400: 00000100:00100000:0.0:1788925253.016117:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788925253.016122:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947702016:12345-0@lo:400: 00000100:00100000:2.0:1788925253.016130:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947701888 00000100:00100000:2.0:1788925253.016133:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947701888 00000100:00100000:0.0:1788925253.016155:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947702016:12345-0@lo:400: Request processed in 32us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925253.016161:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788925253.016461:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788925253.016489:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925253.018336:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947702144 00000100:00100000:2.0:1788925253.018434:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947702144 00000100:00100000:3.0:1788925253.020238:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788925253.020262:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947701888:12345-0@lo:400: 00000100:00100000:3.0:1788925253.020426:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947701888:12345-0@lo:400: Request processed in 174us (4748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925253.020434:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788925253.020460:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788925253.020467:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875823947702144:12345-0@lo:400: 00000100:00100000:2.0:1788925253.020615:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947701504 00000100:00100000:2.0:1788925253.020623:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947701504 00000100:00100000:2.0:1788925253.021453:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788925253.021467:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947701504:12345-0@lo:400: 00000100:00100000:2.0:1788925253.021515:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947701504:12345-0@lo:400: Request processed in 54us (5568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925253.021521:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:2.0:1788925253.021605:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe4a80 x1875823947701760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925253.021619:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875823947701760:0@lo:400: 00010000:00080000:2.0:1788925253.021632:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe7800 x1875823947701888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925253.021639:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947701888:0@lo:400: 00000100:00100000:2.0:1788925253.021664:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925253.022433:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875823947702144:12345-0@lo:400: Request processed in 32us (4622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925253.022444:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925253.022902:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947702272:0@lo:13: 00000100:00100000:2.0:1788925253.022957:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925253.023023:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947701504:0@lo:400: 00010000:00080000:3.0:1788925253.023051:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe6a00 x1875823947702016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925253.023063:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947702016:0@lo:400: 00010000:00080000:3.0:1788925253.023097:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe6300 x1875823947702144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925253.023107:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947702144:0@lo:400: 00000100:00100000:0.0:1788925253.024297:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947702272 00000100:00100000:0.0:1788925253.024312:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947702272 00000100:00100000:2.0:1788925253.024512:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788925253.024522:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947702272:12345-0@lo:13: 00002000:00000024:2.0:1788925253.024564:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925253.024630:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947702272:12345-0@lo:13: Request processed in 109us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925253.024637:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788925253.024748:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482c1880 x1875823947702272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925253.024767:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947702272:0@lo:13: 00000100:00080000:1.0:1788925253.027239:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788925253.463954:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925253.538063:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947702400:0@lo:13: 00000100:00100000:0.0:1788925253.540650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925253.562309:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947702400 00000100:00100000:2.0:1788925253.562328:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947702400 00000100:00100000:2.0:1788925253.562433:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788925253.562449:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875823947702400:12345-0@lo:13: 00002000:00000024:2.0:1788925253.562502:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925253.562637:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875823947702400:12345-0@lo:13: Request processed in 191us (21999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925253.562648:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788925253.562847:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c86e755c00 x1875823947702400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925253.562874:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947702400:0@lo:13: 00000001:00080000:3.0:1788925253.680545:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788925254.486632:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925255.511291:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925256.017234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925256.017948:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921463424 00000100:00100000:0.0:1788925256.017996:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921463424 00000100:00100000:0.0:1788925256.018070:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:0.0:1788925256.018081:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1875823921463424:12345-192.168.204.28@tcp:250: 00010000:00080000:0.0:1788925256.018113:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c9daa795-437c-4e56-9ebb-89af76979400@192.168.204.28@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1788925256.018154:0:5839:0:(genops.c:1385:class_connect()) connect: client c9daa795-437c-4e56-9ebb-89af76979400, cookie 0x503aa1a44b68e4a5 00000100:00080000:0.0:1788925256.018300:0:5839:0:(import.c:65:import_set_state_nolock()) ffff98c74297c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788925256.018375:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+5:2357:x1875823921463424:12345-192.168.204.28@tcp:250: Request processed in 294us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925256.018383:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:3.0:1788925256.022973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925256.023168:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921463552 00000100:00100000:2.0:1788925256.023182:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921463552 00000100:00100000:2.0:1788925256.023254:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 114 00000100:00100000:2.0:1788925256.023266:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+5:5592:x1875823921463552:12345-192.168.204.28@tcp:101: 00010000:00010000:2.0:1788925256.023287:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925256.023323:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c85c218a00/0x503aa1a44b68e4ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1e67 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925256.023360:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c85c218a00/0x503aa1a44b68e4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e67 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925256.023371:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c85c218a00/0x503aa1a44b68e4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e67 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925256.023382:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c85c218a00, rc 0) 00000100:00100000:2.0:1788925256.023547:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+6:5592:x1875823921463552:12345-192.168.204.28@tcp:101: Request processed in 281us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925256.023555:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 114 00000100:00100000:3.0:1788925256.033054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925256.033521:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921463680 00000100:00100000:0.0:1788925256.033539:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921463680 00000100:00100000:0.0:1788925256.033623:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:0.0:1788925256.033658:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+6:5592:x1875823921463680:12345-192.168.204.28@tcp:501: 00000100:00100000:0.0:1788925256.034236:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+6:5592:x1875823921463680:12345-192.168.204.28@tcp:501: Request processed in 515us (1132us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788925256.034245:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:0.0:1788925256.051043:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925256.054357:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921463808 00000100:00100000:3.0:1788925256.054372:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921463808 00000100:00100000:2.0:1788925256.055925:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:2.0:1788925256.055944:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+6:5592:x1875823921463808:12345-192.168.204.28@tcp:101: 00010000:00010000:2.0:1788925256.055963:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925256.055994:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e4b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1e6e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925256.056029:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e6e expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925256.056041:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e6e expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925256.056051:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c85c219800, rc 0) 00000100:00100000:2.0:1788925256.056125:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+7:5592:x1875823921463808:12345-192.168.204.28@tcp:101: Request processed in 187us (5093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925256.060839:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:3.0:1788925256.064819:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925256.066899:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921463936 00000100:00100000:2.0:1788925256.066916:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921463936 00000100:00100000:2.0:1788925256.067003:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:2.0:1788925256.067015:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+7:5592:x1875823921463936:12345-192.168.204.28@tcp:501: 00000100:00100000:2.0:1788925256.067352:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+8:5592:x1875823921463936:12345-192.168.204.28@tcp:501: Request processed in 339us (2558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925256.067361:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:3.0:1788925256.074194:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925256.074576:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921464064 00000100:00100000:2.0:1788925256.074608:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921464064 00000100:00100000:2.0:1788925256.074681:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:2.0:1788925256.074690:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+8:5592:x1875823921464064:12345-192.168.204.28@tcp:503: 00000100:00100000:2.0:1788925256.075082:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+8:5592:x1875823921464064:12345-192.168.204.28@tcp:503: Request processed in 390us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925256.075090:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:3.0:1788925256.086764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925256.087016:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921464192 00000100:00100000:0.0:1788925256.087032:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921464192 00000100:00100000:0.0:1788925256.087104:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 119 00000100:00100000:0.0:1788925256.087116:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+8:5610:x1875823921464192:12345-192.168.204.28@tcp:502: 00000100:00100000:1.0:1788925256.087946:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+8:5610:x1875823921464192:12345-192.168.204.28@tcp:502: Request processed in 819us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925256.087962:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 119 00000100:00100000:3.0:1788925256.125676:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925256.125905:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921464320 00000100:00100000:0.0:1788925256.125920:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921464320 00000100:00100000:0.0:1788925256.126002:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:0.0:1788925256.126015:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+8:5610:x1875823921464320:12345-192.168.204.28@tcp:502: 00000100:00100000:0.0:1788925256.126388:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+8:5610:x1875823921464320:12345-192.168.204.28@tcp:502: Request processed in 374us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925256.126429:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:3.0:1788925256.131250:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925256.131481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921464448 00000100:00100000:2.0:1788925256.131496:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921464448 00000100:00100000:2.0:1788925256.131575:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:2.0:1788925256.131587:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+8:5592:x1875823921464448:12345-192.168.204.28@tcp:101: 00010000:00010000:2.0:1788925256.131604:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925256.131624:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c85c219c00/0x503aa1a44b68e4ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1e98 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925256.131668:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c85c219c00/0x503aa1a44b68e4ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e98 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925256.131680:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c85c219c00/0x503aa1a44b68e4ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e98 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925256.131688:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c85c219c00, rc 0) 00000100:00100000:2.0:1788925256.131767:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+9:5592:x1875823921464448:12345-192.168.204.28@tcp:101: Request processed in 182us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925256.131774:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:3.0:1788925256.142355:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925256.142585:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921464576 00000100:00100000:1.0:1788925256.142598:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921464576 00000100:00100000:1.0:1788925256.142665:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:1.0:1788925256.142678:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+9:5592:x1875823921464576:12345-192.168.204.28@tcp:256: 20000000:01000000:1.0:1788925256.142711:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788925256.142926:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788925256.142936:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788925256.142940:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788925256.142943:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788925256.146570:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+9:5592:x1875823921464576:12345-192.168.204.28@tcp:256: Request processed in 3883us (4219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925256.146585:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:3.0:1788925256.150283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925256.150473:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921464704 00000100:00100000:0.0:1788925256.150489:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921464704 00000100:00100000:0.0:1788925256.150567:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:0.0:1788925256.150578:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+9:5592:x1875823921464704:12345-192.168.204.28@tcp:101: 00010000:00010000:0.0:1788925256.150594:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925256.150613:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c840031800/0x503aa1a44b68e4c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1e9f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925256.150642:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c840031800/0x503aa1a44b68e4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e9f expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925256.150673:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c840031800/0x503aa1a44b68e4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e9f expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925256.150684:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c840031800, rc 0) 00000100:00100000:0.0:1788925256.151009:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:5592:x1875823921464704:12345-192.168.204.28@tcp:101: Request processed in 430us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925256.151016:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:3.0:1788925256.159227:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925256.159455:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921464832 00000100:00100000:1.0:1788925256.159469:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921464832 00000100:00100000:1.0:1788925256.159565:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 124 00000100:00100000:1.0:1788925256.159578:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:5592:x1875823921464832:12345-192.168.204.28@tcp:501: 00000100:00100000:1.0:1788925256.159988:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:5592:x1875823921464832:12345-192.168.204.28@tcp:501: Request processed in 400us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925256.159997:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 124 00000100:00100000:3.0:1788925256.164738:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925256.165913:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921464960 00000100:00100000:0.0:1788925256.165930:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921464960 00000100:00100000:0.0:1788925256.166029:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:0.0:1788925256.166041:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:5592:x1875823921464960:12345-192.168.204.28@tcp:503: 00000100:00100000:0.0:1788925256.170135:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:5592:x1875823921464960:12345-192.168.204.28@tcp:503: Request processed in 4079us (5396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925256.170154:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:3.0:1788925256.174266:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925256.175289:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921465088 00000100:00100000:2.0:1788925256.175331:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921465088 00000100:00100000:2.0:1788925256.175441:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 126 00000100:00100000:2.0:1788925256.175453:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:5614:x1875823921465088:12345-192.168.204.28@tcp:502: 00000100:00100000:2.0:1788925256.178791:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:5614:x1875823921465088:12345-192.168.204.28@tcp:502: Request processed in 3320us (4519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925256.178810:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 126 00000100:00100000:3.0:1788925256.184141:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925256.184351:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921465216 00000100:00100000:0.0:1788925256.184366:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921465216 00000100:00100000:0.0:1788925256.184472:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 127 00000100:00100000:0.0:1788925256.184484:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:5614:x1875823921465216:12345-192.168.204.28@tcp:502: 00000100:00100000:0.0:1788925256.184830:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:5614:x1875823921465216:12345-192.168.204.28@tcp:502: Request processed in 345us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925256.184839:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 127 00000100:00100000:3.0:1788925256.189567:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925256.189706:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921465344 00000100:00100000:0.0:1788925256.189725:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921465344 00000100:00100000:0.0:1788925256.189790:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:0.0:1788925256.189801:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1875823921465344:12345-192.168.204.28@tcp:38: 00010000:00080000:0.0:1788925256.189858:0:5848:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1788925256.189928:0:5848:0:(genops.c:1385:class_connect()) connect: client 5652db64-8dca-43c9-a8d1-41118f535cbb, cookie 0x503aa1a44b68e4c8 00000004:00100000:0.0:1788925256.189969:0:5848:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788925256.189990:0:5848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788925256.256717:0:5848:0:(import.c:65:import_set_state_nolock()) ffff98c742979800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788925256.257146:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2357:x1875823921465344:12345-192.168.204.28@tcp:38: Request processed in 67342us (67589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925256.257161:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00010000:00010000:2.0:1788925256.534740:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925257.263042:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925257.263153:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925257.283242:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921465600 00000100:00100000:2.0:1788925257.283267:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921465600 00000100:00100000:2.0:1788925257.283427:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921465472 00000100:00100000:2.0:1788925257.283432:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921465472 00000100:00100000:2.0:1788925257.283458:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:2.0:1788925257.283471:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+7:5592:x1875823921465600:12345-192.168.204.28@tcp:41: 00000004:00000024:2.0:1788925257.283531:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:1.0:1788925257.284114:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925257.286344:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+7:5592:x1875823921465600:12345-192.168.204.28@tcp:41: Request processed in 2855us (23300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925257.286363:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:2.0:1788925257.286509:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:2.0:1788925257.286531:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:0:x1875823921465472:12345-192.168.204.28@tcp:41: 00000004:00000024:2.0:1788925257.286572:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788925257.299315:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:0:x1875823921465472:12345-192.168.204.28@tcp:41: Request processed in 12774us (36139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925257.299337:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:3.0:1788925257.300804:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925257.300893:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921465728 00000100:00100000:0.0:1788925257.300913:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921465728 00000100:00100000:0.0:1788925257.301007:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:0.0:1788925257.301019:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:5592:x1875823921465728:12345-192.168.204.28@tcp:40: 00000100:00100000:0.0:1788925257.301137:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:5592:x1875823921465728:12345-192.168.204.28@tcp:40: Request processed in 120us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925257.301145:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:3.0:1788925257.310460:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925257.310518:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925257.311270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925257.311793:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925257.311837:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921465856 00000100:00100000:3.0:1788925257.311842:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921465984 00000100:00100000:3.0:1788925257.311858:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921465984 00000100:00100000:1.0:1788925257.311859:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921465856 00000100:00100000:3.0:1788925257.311928:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:3.0:1788925257.311941:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875823921465984:12345-192.168.204.28@tcp:8: 00010000:00080000:3.0:1788925257.311996:0:6699:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp t0 exp 0000000000000000 cur 246 last 0 00000100:00100000:0.0:1788925257.312011:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921466240 00000100:00100000:0.0:1788925257.312020:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921466240 00000020:00000080:0.0:1788925257.312095:0:6699:0:(genops.c:1385:class_connect()) connect: client 5652db64-8dca-43c9-a8d1-41118f535cbb, cookie 0x503aa1a44b68e4cf 00002000:00100000:0.0:1788925257.312115:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5652db64-8dca-43c9-a8d1-41118f535cbb/ffff98c874c52000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1788925257.312129:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 128 00000100:00100000:1.0:1788925257.312147:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921466240:12345-192.168.204.28@tcp:400: 00002000:00100000:0.0:1788925257.312152:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788925257.312240:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921466240:12345-192.168.204.28@tcp:400: Request processed in 100us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925257.312253:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 128 00000100:00100000:2.0:1788925257.314091:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921466112 00000100:00100000:2.0:1788925257.314106:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921466112 00000100:00100000:2.0:1788925257.314184:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:2.0:1788925257.314196:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:5592:x1875823921466112:12345-192.168.204.28@tcp:33: 00002000:00080000:1.0:1788925257.326727:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788925257.326791:0:6699:0:(import.c:65:import_set_state_nolock()) ffff98c86f88e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925257.327670:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2357:x1875823921465984:12345-192.168.204.28@tcp:8: Request processed in 15723us (15870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925257.327683:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:1.0:1788925257.327732:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:1.0:1788925257.327740:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875823921465856:12345-192.168.204.28@tcp:8: 00010000:00080000:1.0:1788925257.327772:0:6699:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1788925257.327807:0:6699:0:(genops.c:1385:class_connect()) connect: client 5652db64-8dca-43c9-a8d1-41118f535cbb, cookie 0x503aa1a44b68e4d6 00002000:00100000:1.0:1788925257.327823:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5652db64-8dca-43c9-a8d1-41118f535cbb/ffff98c86f888800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788925257.327851:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788925257.328304:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788925257.328342:0:6699:0:(import.c:65:import_set_state_nolock()) ffff98c86f88d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925257.328445:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2357:x1875823921465856:12345-192.168.204.28@tcp:8: Request processed in 703us (17176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925257.328452:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000004:00080000:3.0:1788925257.338475:0:5850:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 24187us 00000004:00200000:3.0:1788925257.366256:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1788925257.366477:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:5592:x1875823921466112:12345-192.168.204.28@tcp:33: Request processed in 52275us (56073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925257.366492:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00010000:00010000:1.0:1788925257.558764:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925257.742296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925257.744449:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921466368 00000100:00100000:2.0:1788925257.744851:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921466368 00000100:00100000:2.0:1788925257.744943:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:2.0:1788925257.744968:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:5631:x1875823921466368:12345-192.168.204.28@tcp:101: 00010000:00010000:2.0:1788925257.744989:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925257.745044:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445400/0x503aa1a44b68e4dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1ec9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925257.745120:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e4e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925257.745134:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925257.745149:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925257.745360:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788925257.745365:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788925257.745476:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925257.745506:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445400/0x503aa1a44b68e4dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ec9 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925257.745522:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ec9 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925257.745531:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:2.0:1788925257.745534:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788925257.745537:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e444800, rc 0) 00000100:00100000:2.0:1788925257.745613:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+7:5631:x1875823921466368:12345-192.168.204.28@tcp:101: Request processed in 647us (3326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925257.745627:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:2.0:1788925258.136972:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947702784:0@lo:400: 00000100:00100000:2.0:1788925258.137049:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925258.137119:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788925258.137125:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947702912:0@lo:400: 00000100:00100000:2.0:1788925258.137153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925258.137189:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947702784 00000100:00100000:2.0:1788925258.137197:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947702784 00000100:00100000:2.0:1788925258.137244:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788925258.137254:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947702784:12345-0@lo:400: 00000100:00100000:2.0:1788925258.137302:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947702784:12345-0@lo:400: Request processed in 50us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925258.137309:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788925258.137349:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947702784:0@lo:400: 00000100:00100000:0.0:1788925258.137428:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947702528:0@lo:400: 00000100:00100000:0.0:1788925258.137466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925258.137497:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947703040:0@lo:400: 00000100:00100000:0.0:1788925258.137521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925258.137556:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788925258.137578:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947702656:0@lo:400: 00000100:00100000:0.0:1788925258.137602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925258.137617:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947703168:0@lo:400: 00000100:00100000:0.0:1788925258.137636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925258.137736:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947702912 00000100:00100000:1.0:1788925258.137746:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947702912 00000100:00100000:1.0:1788925258.137775:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947703168 00000100:00100000:1.0:1788925258.137778:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947703168 00000100:00100000:1.0:1788925258.137793:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788925258.137799:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947702912:12345-0@lo:400: 00000100:00100000:1.0:1788925258.137836:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947702912:12345-0@lo:400: Request processed in 38us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925258.137842:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788925258.137853:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788925258.137859:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947703168:12345-0@lo:400: 00000100:00100000:1.0:1788925258.137889:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947703168:12345-0@lo:400: Request processed in 30us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925258.137895:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788925258.137909:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788925258.137913:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788925258.137916:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788925258.137992:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ef100 x1875823947703168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925258.138002:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788925258.138015:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947703168:0@lo:400: 00000100:00100000:0.0:1788925258.139991:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788925258.140011:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947703296:0@lo:13: 00000100:00100000:0.0:1788925258.140064:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925258.140162:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947702528 00000100:00100000:2.0:1788925258.140169:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947702528 00000100:00100000:2.0:1788925258.140217:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788925258.140226:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947702528:12345-0@lo:400: 00000100:00100000:2.0:1788925258.140274:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947702528:12345-0@lo:400: Request processed in 49us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925258.140280:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788925258.140311:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947703296 00000100:00100000:2.0:1788925258.140315:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947703296 00000100:00100000:2.0:1788925258.140340:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788925258.140346:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947703296:12345-0@lo:13: 00002000:00000024:2.0:1788925258.140362:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925258.140436:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947703296:12345-0@lo:13: Request processed in 89us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925258.140443:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788925258.140464:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947703040 00000100:00100000:2.0:1788925258.140467:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947703040 00000100:00100000:2.0:1788925258.140494:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947702656 00000100:00100000:2.0:1788925258.140497:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947702656 00000100:00100000:2.0:1788925258.140508:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788925258.140513:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947703040:12345-0@lo:400: 00000100:00100000:2.0:1788925258.140544:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947703040:12345-0@lo:400: Request processed in 31us (3023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925258.140550:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788925258.140562:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788925258.140567:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947702656:12345-0@lo:400: 00000100:00100000:2.0:1788925258.140594:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947702656:12345-0@lo:400: Request processed in 27us (2991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925258.140600:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788925258.140636:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ed500 x1875823947702912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925258.140649:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947702912:0@lo:400: 00010000:00080000:0.0:1788925258.140747:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c84a0f0700 x1875823947703296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925258.140762:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947703296:0@lo:13: 00000100:00080000:1.0:1788925258.141168:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925258.141194:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947702656:0@lo:400: 00000100:00100000:1.0:1788925258.141205:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947702528:0@lo:400: 00000100:00100000:1.0:1788925258.141214:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947703040:0@lo:400: 00010000:00010000:2.0:1788925258.582572:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925258.646829:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947703424:0@lo:13: 00000100:00100000:2.0:1788925258.646909:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925258.650061:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947703424 00000100:00100000:0.0:1788925258.650076:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947703424 00000100:00100000:0.0:1788925258.650151:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788925258.650162:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947703424:12345-0@lo:13: 00002000:00000024:0.0:1788925258.650196:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925258.650304:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947703424:12345-0@lo:13: Request processed in 143us (3393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925258.650312:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788925258.650447:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c86e757480 x1875823947703424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925258.650471:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947703424:0@lo:13: 00010000:00010000:1.0:1788925259.608556:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788925259.776151:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5652db64-8dca-43c9-a8d1-41118f535cbb 00000100:00100000:3.0:1788925260.472430:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925260.472545:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921466496 00000100:00100000:0.0:1788925260.472557:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921466496 00000100:00100000:0.0:1788925260.472650:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:0.0:1788925260.472662:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+7:5684:x1875823921466496:12345-192.168.204.28@tcp:41: 00000004:00000024:0.0:1788925260.472707:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788925260.472772:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+7:5684:x1875823921466496:12345-192.168.204.28@tcp:41: Request processed in 112us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925260.472780:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00080000:1.0:1788925260.472930:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925260.484013:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925260.484180:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921466624 00000100:00100000:0.0:1788925260.484190:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921466624 00000100:00100000:0.0:1788925260.484265:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1788925260.484276:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5652db64-8dca-43c9-a8d1-41118f535cbb+5:5684:x1875823921466624:12345-192.168.204.28@tcp:13: 00002000:00000024:0.0:1788925260.484317:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925260.484387:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5652db64-8dca-43c9-a8d1-41118f535cbb+5:5684:x1875823921466624:12345-192.168.204.28@tcp:13: Request processed in 112us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925260.484395:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00080000:1.0:1788925260.484483:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925260.491118:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925260.491325:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921466752 00000100:00100000:2.0:1788925260.491336:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921466752 00000100:00100000:2.0:1788925260.491457:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:2.0:1788925260.491486:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5652db64-8dca-43c9-a8d1-41118f535cbb+6:5684:x1875823921466752:12345-192.168.204.28@tcp:13: 00002000:00000024:2.0:1788925260.491529:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925260.491603:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5652db64-8dca-43c9-a8d1-41118f535cbb+6:5684:x1875823921466752:12345-192.168.204.28@tcp:13: Request processed in 120us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925260.491621:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00080000:1.0:1788925260.491698:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788925260.630579:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788925261.320866:0:5870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5652db64-8dca-43c9-a8d1-41118f535cbb 00000001:00100000:3.0:1788925261.326989:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5652db64-8dca-43c9-a8d1-41118f535cbb 00010000:00010000:1.0:1788925261.654578:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925262.445017:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925262.445145:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925262.445259:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925262.445304:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925262.445393:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921467008 00000100:00100000:0.0:1788925262.445442:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921467008 00000100:00100000:0.0:1788925262.445548:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:0.0:1788925262.445559:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921467008:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1788925262.445656:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921467008:12345-192.168.204.28@tcp:400: Request processed in 98us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925262.445666:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:1.0:1788925262.445680:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921466880 00000100:00100000:1.0:1788925262.445688:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921466880 00000100:00100000:1.0:1788925262.445736:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 130 00000100:00100000:1.0:1788925262.445745:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921466880:12345-192.168.204.28@tcp:400: 00000100:00100000:1.0:1788925262.445782:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921466880:12345-192.168.204.28@tcp:400: Request processed in 38us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925262.445791:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 130 00000100:00080000:0.0:1788925262.445843:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925262.447267:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921467136 00000100:00100000:2.0:1788925262.447283:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921467136 00000100:00100000:1.0:1788925262.447328:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921467264 00000100:00100000:1.0:1788925262.447335:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921467264 00000100:00100000:2.0:1788925262.447378:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:1.0:1788925262.447388:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:2.0:1788925262.447395:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2361:x1875823921467136:12345-192.168.204.28@tcp:400: 00000100:00100000:1.0:1788925262.447420:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ceff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2361:x1875823921467264:12345-192.168.204.28@tcp:400: 00000100:00100000:2.0:1788925262.447507:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2361:x1875823921467136:12345-192.168.204.28@tcp:400: Request processed in 118us (2362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925262.447515:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:1.0:1788925262.448125:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ceff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2361:x1875823921467264:12345-192.168.204.28@tcp:400: Request processed in 722us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925262.448134:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00080000:0.0:1788925262.450095:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788925262.450112:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788925262.679185:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925263.255090:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947703552:0@lo:400: 00000100:00100000:1.0:1788925263.255169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925263.255235:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947704064:0@lo:400: 00000100:00100000:1.0:1788925263.255263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925263.255289:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788925263.255294:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947703680:0@lo:400: 00000100:00100000:1.0:1788925263.255317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925263.255337:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947704192:0@lo:400: 00000100:00100000:1.0:1788925263.255360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925263.255424:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947704064 00000100:00100000:1.0:1788925263.255432:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947704064 00000100:00100000:1.0:1788925263.255486:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947703680 00000100:00100000:1.0:1788925263.255489:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947703680 00000100:00100000:1.0:1788925263.255507:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788925263.255515:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947704064:12345-0@lo:400: 00000100:00100000:1.0:1788925263.255566:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947704064:12345-0@lo:400: Request processed in 51us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925263.255573:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788925263.255590:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788925263.255596:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947703680:12345-0@lo:400: 00000100:00100000:1.0:1788925263.255624:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947703680:12345-0@lo:400: Request processed in 28us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925263.255630:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788925263.255646:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925263.255914:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947703680:0@lo:400: 00000100:00100000:1.0:1788925263.255935:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947704064:0@lo:400: 00000100:00100000:3.0:1788925263.256107:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947703808:0@lo:400: 00000100:00100000:3.0:1788925263.256138:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925263.256188:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87cefc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947704320:0@lo:13: 00000100:00100000:3.0:1788925263.256213:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925263.256234:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925263.256240:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947703936:0@lo:400: 00000100:00100000:3.0:1788925263.256258:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925263.256284:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947703808 00000100:00100000:3.0:1788925263.256289:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947703808 00000100:00100000:3.0:1788925263.256321:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788925263.256328:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947703808:12345-0@lo:400: 00000100:00100000:3.0:1788925263.256364:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947703808:12345-0@lo:400: Request processed in 36us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925263.256371:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788925263.256390:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947704192 00000100:00100000:3.0:1788925263.256394:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947704192 00000100:00100000:3.0:1788925263.256442:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947703936 00000100:00100000:3.0:1788925263.256446:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947703936 00000100:00100000:3.0:1788925263.256461:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788925263.256467:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947704192:12345-0@lo:400: 00000100:00100000:3.0:1788925263.256503:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947704192:12345-0@lo:400: Request processed in 36us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925263.256509:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788925263.256521:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788925263.256527:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947703936:12345-0@lo:400: 00000100:00100000:3.0:1788925263.256556:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947703936:12345-0@lo:400: Request processed in 30us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925263.256562:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788925263.256579:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947704320 00000100:00100000:3.0:1788925263.256582:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947704320 00000100:00100000:3.0:1788925263.256610:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788925263.256616:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ceffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947704320:12345-0@lo:13: 00002000:00000024:3.0:1788925263.256642:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925263.256675:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ceffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947704320:12345-0@lo:13: Request processed in 59us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925263.256876:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947703552 00000100:00100000:2.0:1788925263.256880:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947703552 00000100:00100000:2.0:1788925263.256910:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788925263.256918:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947703552:12345-0@lo:400: 00000100:00100000:2.0:1788925263.256955:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947703552:12345-0@lo:400: Request processed in 37us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925263.256961:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:2.0:1788925263.257020:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ee680 x1875823947703936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925263.257031:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947703936:0@lo:400: 00000100:00100000:2.0:1788925263.257043:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947703808:0@lo:400: 00010000:00080000:2.0:1788925263.257062:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87cefc380 x1875823947704320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925263.257076:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87cefc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947704320:0@lo:13: 00000100:00080000:2.0:1788925263.257106:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788925263.257110:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788925263.257113:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788925263.257140:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9edc00 x1875823947704192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925263.257151:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947704192:0@lo:400: 00000100:00100000:2.0:1788925263.257161:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947703552:0@lo:400: 00000100:00100000:3.0:1788925263.257221:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1788925263.702763:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925263.775136:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947704448:0@lo:13: 00000100:00100000:1.0:1788925263.775238:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925263.775305:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947704448 00000100:00100000:0.0:1788925263.775316:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947704448 00000100:00100000:0.0:1788925263.775393:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788925263.775424:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947704448:12345-0@lo:13: 00002000:00000024:0.0:1788925263.775574:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925263.775624:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947704448:12345-0@lo:13: Request processed in 203us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925263.775631:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788925263.792747:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c86e756d80 x1875823947704448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925263.792779:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947704448:0@lo:13: 00000001:02000400:1.0:1788925263.997675:0:8306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788925264.735965:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925265.750531:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925266.775584:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925267.570216:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925267.570258:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925267.570354:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925267.570371:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921467648 00000100:00100000:3.0:1788925267.570395:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921467648 00000100:00100000:0.0:1788925267.570395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925267.570477:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921467520 00000100:00100000:0.0:1788925267.570484:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921467520 00000100:00100000:3.0:1788925267.570506:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921467776 00000100:00100000:3.0:1788925267.570512:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921467776 00000100:00100000:3.0:1788925267.570540:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:0.0:1788925267.570555:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:3.0:1788925267.570562:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2361:x1875823921467648:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1788925267.570570:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921467520:12345-192.168.204.28@tcp:400: 00000100:00100000:3.0:1788925267.570650:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2361:x1875823921467648:12345-192.168.204.28@tcp:400: Request processed in 101us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925267.570658:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:3.0:1788925267.570676:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:3.0:1788925267.570683:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2361:x1875823921467776:12345-192.168.204.28@tcp:400: 00000100:00100000:1.0:1788925267.570700:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921467392 00000100:00100000:1.0:1788925267.570717:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921467392 00000100:00100000:1.0:1788925267.570761:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 132 00000100:00100000:1.0:1788925267.570783:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921467392:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1788925267.570858:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921467520:12345-192.168.204.28@tcp:400: Request processed in 293us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925267.570865:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00080000:2.0:1788925267.572891:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788925267.572902:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788925267.572904:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925267.579156:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2361:x1875823921467776:12345-192.168.204.28@tcp:400: Request processed in 8457us (8746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925267.579173:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:1.0:1788925267.601335:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921467392:12345-192.168.204.28@tcp:400: Request processed in 30553us (31115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925267.601351:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 132 00010000:00010000:2.0:1788925267.799383:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925268.374579:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947704576:0@lo:13: 00000100:00100000:1.0:1788925268.374630:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947704832:0@lo:400: 00000100:00100000:1.0:1788925268.374688:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925268.374698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925268.374792:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947704576 00000100:00100000:0.0:1788925268.374801:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947704576 00000100:00100000:0.0:1788925268.374867:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788925268.374879:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947704576:12345-0@lo:13: 00002000:00000024:0.0:1788925268.374920:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925268.374968:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947704576:12345-0@lo:13: Request processed in 92us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925268.374976:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788925268.375160:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947705344:0@lo:400: 00000100:00100000:1.0:1788925268.375189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925268.375228:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925268.375234:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947704960:0@lo:400: 00000100:00100000:1.0:1788925268.375258:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925268.375291:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947704832 00000100:00100000:1.0:1788925268.375296:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947704832 00000100:00100000:1.0:1788925268.375326:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947704960 00000100:00100000:1.0:1788925268.375329:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947704960 00000100:00100000:1.0:1788925268.375347:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788925268.375354:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947704832:12345-0@lo:400: 00000100:00100000:1.0:1788925268.375393:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947704832:12345-0@lo:400: Request processed in 40us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925268.375427:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788925268.375457:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788925268.375464:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947704960:12345-0@lo:400: 00000100:00100000:1.0:1788925268.375498:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947704960:12345-0@lo:400: Request processed in 35us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925268.375505:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788925268.375560:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947704960:0@lo:400: 00000100:00100000:1.0:1788925268.375572:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947704832:0@lo:400: 00000100:00100000:3.0:1788925268.377641:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947704704:0@lo:400: 00000100:00100000:3.0:1788925268.377727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925268.377794:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947705216:0@lo:400: 00000100:00100000:3.0:1788925268.377824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925268.377887:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925268.377906:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947705088:0@lo:400: 00000100:00100000:3.0:1788925268.377936:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788925268.379526:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788925268.379537:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925268.381517:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947705344 00000100:00100000:3.0:1788925268.381538:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947705344 00000100:00100000:3.0:1788925268.381624:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947705088 00000100:00100000:3.0:1788925268.381628:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947705088 00000100:00100000:3.0:1788925268.381650:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925268.381660:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947705344:12345-0@lo:400: 00000100:00100000:3.0:1788925268.381775:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947705344:12345-0@lo:400: Request processed in 116us (6584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925268.381782:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925268.381802:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788925268.381810:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947705088:12345-0@lo:400: 00000100:00100000:3.0:1788925268.381847:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947705088:12345-0@lo:400: Request processed in 39us (3910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925268.381853:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788925268.381871:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788925268.381910:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87d1b8000 x1875823947705088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925268.381926:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947705088:0@lo:400: 00000100:00100000:1.0:1788925268.383477:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947704704 00000100:00100000:1.0:1788925268.383488:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947704704 00000100:00100000:1.0:1788925268.383553:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788925268.383563:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947704704:12345-0@lo:400: 00000100:00100000:1.0:1788925268.383652:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947704704:12345-0@lo:400: Request processed in 90us (5925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925268.383661:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788925268.383702:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947705216 00000100:00100000:1.0:1788925268.383706:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947705216 00000100:00100000:1.0:1788925268.383745:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788925268.383752:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947705216:12345-0@lo:400: 00000100:00100000:1.0:1788925268.383799:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947705216:12345-0@lo:400: Request processed in 48us (5974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925268.383805:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788925268.383845:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87d1bb480 x1875823947705344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925268.383859:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947705344:0@lo:400: 00000100:00080000:1.0:1788925268.383887:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925268.383906:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947704704:0@lo:400: 00000100:00100000:1.0:1788925268.383920:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947705216:0@lo:400: 00010000:00080000:2.0:1788925268.384696:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ec700 x1875823947704576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925268.384715:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947704576:0@lo:13: 00010000:00010000:2.0:1788925268.822595:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788925268.865076:0:8455:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeeb4b4be0 20000000:00000080:3.0:1788925268.865097:0:8455:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c87d343000 uarg=0000000000000000 20000000:01000000:3.0:1788925268.865134:0:8455:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788925268.865136:0:8455:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788925268.865139:0:8455:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788925268.865144:0:8455:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788925268.865155:0:8455:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788925268.865169:0:8455:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788925268.865172:0:8455:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788925268.865547:0:8455:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788925268.865551:0:8455:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788925268.868477:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788925268.869195:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788925268.869250:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788925268.869287:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788925268.869298:0:8455:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788925268.869301:0:8455:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788925268.872022:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788925268.872578:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788925268.872637:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788925268.872669:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788925268.872680:0:8455:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788925268.872683:0:8455:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788925268.873887:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788925268.879881:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788925268.880067:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788925268.880196:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788925268.880215:0:8455:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788925268.880218:0:8455:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000100:00100000:1.0:1788925268.888221:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947705472:0@lo:13: 00000100:00100000:1.0:1788925268.888301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925268.888447:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947705472 00000100:00100000:2.0:1788925268.888456:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947705472 00000100:00100000:2.0:1788925268.888508:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788925268.888535:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947705472:12345-0@lo:13: 00002000:00000024:2.0:1788925268.888573:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925268.888621:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947705472:12345-0@lo:13: Request processed in 89us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925268.888629:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788925268.888824:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ec700 x1875823947705472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925268.888852:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947705472:0@lo:13: 00000040:00080000:0.0:1788925268.895225:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788925268.901106:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788925268.901189:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788925268.901236:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:2.0:1788925268.901259:0:8455:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788925268.901278:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901296:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e3e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e3e1 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901305:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c861867200/0x503aa1a44b68e412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e40b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901312:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c85c219400/0x503aa1a44b68e43c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e435 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901318:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c840031000/0x503aa1a44b68e44a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e443 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901325:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c840031c00/0x503aa1a44b68e458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e451 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901332:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c85c218800/0x503aa1a44b68e474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e46d expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901339:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e49e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e497 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901357:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c85c218a00/0x503aa1a44b68e4ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e67 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901364:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e4b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e6e expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901370:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901430:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e6e expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901451:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e4b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e6e expref: 9 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925268.901466:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947705600:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788925268.901568:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c85c218a00/0x503aa1a44b68e4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e67 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901577:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c85c218a00/0x503aa1a44b68e4ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e67 expref: 9 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925268.901586:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947705728:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788925268.901621:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e497 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901629:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e49e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e497 expref: 18 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925268.901652:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947705856:0@lo:104: 00000100:00100000:2.0:1788925268.901713:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788925268.901774:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c85c218800/0x503aa1a44b68e474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e46d expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901783:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c85c218800/0x503aa1a44b68e474 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e46d expref: 18 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925268.901791:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947705984:0@lo:104: 00000100:00100000:2.0:1788925268.901812:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788925268.901831:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c840031c00/0x503aa1a44b68e458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e451 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901839:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c840031c00/0x503aa1a44b68e458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e451 expref: 18 pid: 5839 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925268.901847:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947706112:0@lo:104: 00010000:00010000:2.0:1788925268.901872:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c840031000/0x503aa1a44b68e44a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e443 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901880:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c840031000/0x503aa1a44b68e44a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e443 expref: 18 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925268.901888:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947706240:0@lo:104: 00010000:00010000:2.0:1788925268.901927:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c85c219400/0x503aa1a44b68e43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e435 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901936:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c85c219400/0x503aa1a44b68e43c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e435 expref: 18 pid: 5839 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925268.901952:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947706368:0@lo:104: 00010000:00010000:2.0:1788925268.901981:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c861867200/0x503aa1a44b68e412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e40b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.901989:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c861867200/0x503aa1a44b68e412 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e40b expref: 18 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925268.901997:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947706496:0@lo:104: 00010000:00010000:2.0:1788925268.902021:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e3e1 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925268.902029:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e3e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e3e1 expref: 18 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925268.902036:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947706624:0@lo:104: 00000100:00100000:2.0:1788925268.902059:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c862ea30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925268.902963:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788925268.902989:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925268.903017:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925268.903025:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925268.903033:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925268.903042:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925268.903050:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947705856 00000100:00100000:3.0:1788925268.903058:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947705856 00000100:00100000:3.0:1788925268.903115:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947705984 00000100:00100000:3.0:1788925268.903118:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947705984 00000100:00100000:3.0:1788925268.903129:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947706112 00000100:00100000:3.0:1788925268.903131:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947706112 00000100:00100000:3.0:1788925268.903138:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947706240 00000100:00100000:3.0:1788925268.903140:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947706240 00000100:00100000:3.0:1788925268.903147:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947706368 00000100:00100000:3.0:1788925268.903149:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947706368 00000100:00100000:3.0:1788925268.903156:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947706496 00000100:00100000:3.0:1788925268.903157:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947706496 00000100:00100000:3.0:1788925268.903178:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947706624 00000100:00100000:3.0:1788925268.903181:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947706624 00000100:00100000:3.0:1788925268.903193:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925268.903201:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:8455:x1875823947705856:12345-0@lo:104: 00010000:00010000:3.0:1788925268.903215:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e49e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903269:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788925268.903274:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+9:8455:x1875823947705856:12345-0@lo:104: Request processed in 74us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925268.903281:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925268.903297:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788925268.903303:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+8:8455:x1875823947705984:12345-0@lo:104: 00010000:00010000:3.0:1788925268.903310:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903342:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788925268.903347:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e4a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+8:8455:x1875823947705984:12345-0@lo:104: Request processed in 45us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925268.903352:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788925268.903380:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925268.903385:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+7:8455:x1875823947706112:12345-0@lo:104: 00010000:00010000:3.0:1788925268.903392:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e458 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903444:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788925268.903449:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+7:8455:x1875823947706112:12345-0@lo:104: Request processed in 64us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925268.903463:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925268.903476:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788925268.903482:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ceff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+6:8455:x1875823947706240:12345-0@lo:104: 00010000:00010000:3.0:1788925268.903490:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e44a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903516:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788925268.903521:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ceff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+6:8455:x1875823947706240:12345-0@lo:104: Request processed in 40us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925268.903526:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788925268.903537:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788925268.903542:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+5:8455:x1875823947706368:12345-0@lo:104: 00010000:00010000:3.0:1788925268.903549:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e43c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903575:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788925268.903580:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+5:8455:x1875823947706368:12345-0@lo:104: Request processed in 39us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925268.903585:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788925268.903598:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788925268.903603:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+4:8455:x1875823947706496:12345-0@lo:104: 00010000:00010000:3.0:1788925268.903611:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e412 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903636:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788925268.903642:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+4:8455:x1875823947706496:12345-0@lo:104: Request processed in 39us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925268.903653:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788925268.903666:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788925268.903672:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ceff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:8455:x1875823947706624:12345-0@lo:104: 00010000:00010000:3.0:1788925268.903679:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e3e8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903708:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788925268.903713:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ceff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:8455:x1875823947706624:12345-0@lo:104: Request processed in 42us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925268.903718:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788925268.903741:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788925268.903747:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e49e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903766:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c85c219200 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925268.903770:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e49e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903778:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e49e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925268.903786:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e49e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925268.903792:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925268.903823:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e49e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903829:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925268.903854:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e49e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903861:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c85c219200/0x503aa1a44b68e497 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e49e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903875:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788925268.903878:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903883:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c840030a00 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925268.903886:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903892:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925268.903897:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925268.903902:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925268.903915:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903920:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925268.903925:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903931:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c840030a00/0x503aa1a44b68e46d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903941:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788925268.903951:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e458 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903957:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c85c219e00 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925268.903959:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e458 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903965:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e458 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925268.903971:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e458 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925268.903976:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925268.903989:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e458 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.903994:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925268.904010:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e458 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904017:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c85c219e00/0x503aa1a44b68e451 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e458 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904026:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788925268.904029:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e44a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904035:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c840030200 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925268.904038:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e44a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904055:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e44a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925268.904061:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e44a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925268.904066:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925268.904082:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e44a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904088:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925268.904093:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e44a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904100:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c840030200/0x503aa1a44b68e443 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e44a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904109:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788925268.904112:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e43c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904118:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c85c218000 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925268.904121:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e43c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904127:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e43c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925268.904133:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e43c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925268.904145:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925268.904160:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e43c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904166:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925268.904171:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e43c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904177:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c85c218000/0x503aa1a44b68e435 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e43c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904186:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788925268.904189:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e412 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904194:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c840031200 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925268.904196:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e412 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904202:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e412 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925268.904207:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e412 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925268.904212:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925268.904223:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e412 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904229:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925268.904240:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e412 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904246:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c840031200/0x503aa1a44b68e40b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e412 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904256:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925268.904259:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e3e8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904265:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c85c218600 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925268.904268:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e3e8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904274:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e3e8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925268.904279:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e3e8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925268.904284:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925268.904310:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e3e8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904316:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925268.904320:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e3e8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904326:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c85c218600/0x503aa1a44b68e3e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e3e8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904343:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925268.904350:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925268.904352:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925268.904360:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925268.904375:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87cefd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947707008:0@lo:103: 00000100:00100000:3.0:1788925268.904451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925268.904484:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947707520:0@lo:103: 00000100:00100000:3.0:1788925268.904503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925268.904521:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925268.904527:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87cefc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947707136:0@lo:103: 00000100:00100000:3.0:1788925268.904549:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925268.904576:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947707008 00000100:00100000:3.0:1788925268.904581:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947707008 00010000:00010000:3.0:1788925268.904602:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c840031c00/0x503aa1a44b68e458 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e451 expref: 19 pid: 5839 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925268.904619:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947707520 00000100:00100000:3.0:1788925268.904621:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947707520 00010000:00010000:3.0:1788925268.904631:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e3e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e3e1 expref: 20 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925268.904640:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947707136 00000100:00100000:3.0:1788925268.904643:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947707136 00010000:00010000:3.0:1788925268.904652:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c840031000/0x503aa1a44b68e44a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e443 expref: 21 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925268.904663:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925268.904669:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+21:3307:x1875823947707008:12345-0@lo:103: 00010000:00010000:3.0:1788925268.904679:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925268.904684:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c840031c00/0x503aa1a44b68e458 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e451 expref: 21 pid: 5839 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904698:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c840031c00/0x503aa1a44b68e458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e451 expref: 21 pid: 5839 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904713:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925268.904744:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+21:3307:x1875823947707008:12345-0@lo:103: Request processed in 75us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925268.904763:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925268.904777:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788925268.904783:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+20:3307:x1875823947707520:12345-0@lo:103: 00010000:00010000:3.0:1788925268.904791:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925268.904795:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e3e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e3e1 expref: 20 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904803:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e3e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e3e1 expref: 20 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904813:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925268.904835:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+20:3307:x1875823947707520:12345-0@lo:103: Request processed in 53us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925268.904841:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788925268.904853:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925268.904859:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3307:x1875823947707136:12345-0@lo:103: 00010000:00010000:3.0:1788925268.904868:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925268.904873:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c840031000/0x503aa1a44b68e44a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e443 expref: 19 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904880:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c840031000/0x503aa1a44b68e44a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e443 expref: 19 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.904895:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925268.904917:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3307:x1875823947707136:12345-0@lo:103: Request processed in 59us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925268.904922:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925268.905137:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87cefc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947707136:0@lo:103: 00000100:00100000:3.0:1788925268.905146:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87cefd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947707008:0@lo:103: 00000100:00100000:3.0:1788925268.905152:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947707520:0@lo:103: 00000100:00100000:2.0:1788925268.905611:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87cefdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947706752:0@lo:103: 00000100:00100000:2.0:1788925268.905648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925268.905670:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947707264:0@lo:103: 00000100:00100000:2.0:1788925268.905689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925268.905702:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788925268.905707:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87cefdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947706880:0@lo:103: 00000100:00100000:2.0:1788925268.905727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925268.905736:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947707392:0@lo:103: 00000100:00100000:2.0:1788925268.905767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925268.905822:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947705856:0@lo:104: 00000100:00100000:2.0:1788925268.905832:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947705984:0@lo:104: 00010000:00010000:2.0:1788925268.905842:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c840031c00/0x503aa1a44b68e458 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e451 expref: 18 pid: 5839 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925268.905854:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947706112:0@lo:104: 00010000:00010000:2.0:1788925268.905864:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c840031000/0x503aa1a44b68e44a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e443 expref: 17 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925268.905871:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947706240:0@lo:104: 00000100:00100000:2.0:1788925268.905879:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947706368:0@lo:104: 00000100:00100000:2.0:1788925268.905886:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947706496:0@lo:104: 00010000:00010000:2.0:1788925268.905908:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e3e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e3e1 expref: 16 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925268.905917:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947706624:0@lo:104: 00000100:00100000:0.0:1788925268.906136:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947706752 00000100:00100000:0.0:1788925268.906142:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947706752 00010000:00010000:0.0:1788925268.906165:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e49e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e497 expref: 16 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925268.906193:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947707264 00000100:00100000:0.0:1788925268.906196:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947707264 00010000:00010000:0.0:1788925268.906208:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c85c219400/0x503aa1a44b68e43c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e435 expref: 17 pid: 5839 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925268.906217:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947706880 00000100:00100000:0.0:1788925268.906219:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947706880 00010000:00010000:0.0:1788925268.906228:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c85c218800/0x503aa1a44b68e474 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e46d expref: 18 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925268.906236:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947707392 00000100:00100000:0.0:1788925268.906238:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947707392 00010000:00010000:0.0:1788925268.906246:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c861867200/0x503aa1a44b68e412 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e40b expref: 19 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925268.906257:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788925268.906263:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947706752:12345-0@lo:103: 00010000:00010000:0.0:1788925268.906273:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925268.906277:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e49e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e497 expref: 19 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925268.906285:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e497 expref: 19 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925268.906297:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e49e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e497 expref: 19 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925268.906307:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925268.906348:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:3305:x1875823947706752:12345-0@lo:103: Request processed in 85us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925268.906365:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788925268.906379:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788925268.906384:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:3305:x1875823947707264:12345-0@lo:103: 00010000:00010000:0.0:1788925268.906393:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925268.906397:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c85c219400/0x503aa1a44b68e43c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e435 expref: 17 pid: 5839 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925268.906437:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c85c219400/0x503aa1a44b68e43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e435 expref: 17 pid: 5839 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925268.906447:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c85c219400/0x503aa1a44b68e43c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e435 expref: 17 pid: 5839 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925268.906455:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925268.906479:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:3305:x1875823947707264:12345-0@lo:103: Request processed in 94us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925268.906485:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788925268.906497:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788925268.906503:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:3305:x1875823947706880:12345-0@lo:103: 00010000:00010000:0.0:1788925268.906510:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925268.906514:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c85c218800/0x503aa1a44b68e474 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e46d expref: 15 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925268.906522:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c85c218800/0x503aa1a44b68e474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e46d expref: 15 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925268.906531:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c85c218800/0x503aa1a44b68e474 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e46d expref: 15 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925268.906550:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925268.906574:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:3305:x1875823947706880:12345-0@lo:103: Request processed in 71us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925268.906580:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788925268.906594:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788925268.906600:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8478a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:3305:x1875823947707392:12345-0@lo:103: 00010000:00010000:0.0:1788925268.906607:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925268.906611:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c861867200/0x503aa1a44b68e412 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e40b expref: 13 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925268.906619:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c861867200/0x503aa1a44b68e412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e40b expref: 13 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925268.906630:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c861867200/0x503aa1a44b68e412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e40b expref: 13 pid: 5840 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925268.906641:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925268.906660:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8478a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:3305:x1875823947707392:12345-0@lo:103: Request processed in 61us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925268.906666:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788925268.906806:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87cefdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947706880:0@lo:103: 00000100:00100000:2.0:1788925268.906814:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947707392:0@lo:103: 00000100:00100000:2.0:1788925268.906821:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87cefdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947706752:0@lo:103: 00000100:00100000:2.0:1788925268.906827:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947707264:0@lo:103: 00000100:00100000:2.0:1788925268.918223:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947705600:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788925268.918240:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1875823947705728:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788925268.918284:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925268.919587:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925268.919620:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925268.919694:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921467904 00000100:00100000:1.0:1788925268.919702:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921467904 00010000:00010000:1.0:1788925268.919744:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e4b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e6e expref: 10 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925268.919788:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921468032 00000100:00100000:1.0:1788925268.919792:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921468032 00010000:00010000:1.0:1788925268.919807:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c85c218a00/0x503aa1a44b68e4ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e67 expref: 11 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925268.919829:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:3.0:1788925268.919841:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9daa795-437c-4e56-9ebb-89af76979400+11:2361:x1875823921467904:12345-192.168.204.28@tcp:103: 00010000:00010000:3.0:1788925268.919854:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925268.919862:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e4b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e6e expref: 11 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.919879:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e6e expref: 11 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925268.919887:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1788925268.919898:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c85c219800/0x503aa1a44b68e4b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e6e expref: 11 pid: 5840 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925268.919906:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788925268.919914:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925268.919981:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921467904:12345-192.168.204.28@tcp:103: Request processed in 142us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925268.924048:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:1.0:1788925268.924083:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921468032:12345-192.168.204.28@tcp:103: 00010000:00010000:1.0:1788925268.924106:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925268.924116:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c85c218a00/0x503aa1a44b68e4ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e67 expref: 10 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925268.924138:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c85c218a00/0x503aa1a44b68e4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e67 expref: 10 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925268.924159:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c85c218a00/0x503aa1a44b68e4ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e67 expref: 10 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925268.924176:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925268.924183:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925268.924219:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925268.924226:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925268.924233:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925268.924240:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925268.924247:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e445600 already unused, calling callback (ffffffffc15c6230) 00010000:00010000:1.0:1788925268.924252:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925268.924260:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925268.924277:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925268.924287:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925268.924354:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9daa795-437c-4e56-9ebb-89af76979400+9:2361:x1875823921468032:12345-192.168.204.28@tcp:103: Request processed in 291us (4733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925268.924362:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:3.0:1788925268.927224:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00010000:00010000:3.0:1788925268.927953:0:8455:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.927967:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925268.927975:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c86e445600/0x503aa1a44b68e4eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925269.483892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925269.484636:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921468160 00000100:00100000:1.0:1788925269.484648:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921468160 00000100:00100000:1.0:1788925269.484713:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 134 00000100:00100000:1.0:1788925269.484723:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+8:5606:x1875823921468160:12345-192.168.204.28@tcp:101: 00010000:00010000:1.0:1788925269.484767:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925269.484788:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c861866800/0x503aa1a44b68e4f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1ed0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925269.484816:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c861866800/0x503aa1a44b68e4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ed0 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925269.484827:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c861866800/0x503aa1a44b68e4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ed0 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925269.484838:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c861866800, rc 0) 00000100:00100000:1.0:1788925269.484904:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+9:5606:x1875823921468160:12345-192.168.204.28@tcp:101: Request processed in 182us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925269.484912:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 134 00000100:00100000:1.0:1788925269.499374:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925269.500160:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921468288 00000100:00100000:0.0:1788925269.500171:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921468288 00000100:00100000:0.0:1788925269.500272:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 135 00000100:00100000:0.0:1788925269.500282:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+9:5606:x1875823921468288:12345-192.168.204.28@tcp:501: 00000100:00100000:0.0:1788925269.501039:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+9:5606:x1875823921468288:12345-192.168.204.28@tcp:501: Request processed in 757us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925269.501055:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 135 00000100:00100000:0.0:1788925269.504930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925269.507651:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921468416 00000100:00100000:2.0:1788925269.507666:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921468416 00000100:00100000:2.0:1788925269.507750:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 136 00000100:00100000:2.0:1788925269.507761:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+9:5606:x1875823921468416:12345-192.168.204.28@tcp:503: 00000100:00100000:2.0:1788925269.508425:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+9:5606:x1875823921468416:12345-192.168.204.28@tcp:503: Request processed in 663us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925269.508434:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 136 00000100:00100000:3.0:1788925269.515533:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925269.515887:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921468544 00000100:00100000:2.0:1788925269.515897:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921468544 00000100:00100000:2.0:1788925269.515956:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 137 00000100:00100000:2.0:1788925269.515966:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+9:6072:x1875823921468544:12345-192.168.204.28@tcp:502: 00000100:00100000:2.0:1788925269.516225:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+9:6072:x1875823921468544:12345-192.168.204.28@tcp:502: Request processed in 259us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925269.516233:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 137 00000100:00100000:3.0:1788925269.519594:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925269.519756:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921468672 00000100:00100000:2.0:1788925269.519766:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921468672 00000100:00100000:2.0:1788925269.519821:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 138 00000100:00100000:2.0:1788925269.519831:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+9:6072:x1875823921468672:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788925269.520108:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+9:6072:x1875823921468672:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 278us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925269.520116:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 138 00000100:00100000:0.0:1788925269.523982:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925269.524363:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921468800 00000100:00100000:1.0:1788925269.524374:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921468800 00000100:00100000:1.0:1788925269.524453:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 139 00000100:00100000:1.0:1788925269.524462:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+9:5606:x1875823921468800:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925269.524485:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925269.524501:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c861866600/0x503aa1a44b68e4f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1ed7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925269.524534:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c861866600/0x503aa1a44b68e4f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ed7 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925269.524545:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c861866600/0x503aa1a44b68e4f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ed7 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925269.524573:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c861866600, rc 0) 00000100:00100000:1.0:1788925269.524628:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921468800:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 167us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925269.524635:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 139 00000100:00100000:3.0:1788925269.528289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925269.528423:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921468928 00000100:00100000:0.0:1788925269.528432:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921468928 00000100:00100000:0.0:1788925269.528487:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 140 00000100:00100000:0.0:1788925269.528496:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921468928:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925269.528755:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921468928:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 259us (473us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788925269.528764:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 140 00010000:00010000:3.0:1788925269.846758:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788925270.551662:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788925270.551669:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c87ffa4000 from 39 10000000:01000000:2.0:1788925270.551674:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788925270.551716:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c86e444a00/0x503aa1a44b68e500 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.551744:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c86e444a00/0x503aa1a44b68e500 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.551756:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c86e444a00/0x503aa1a44b68e500 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925270.551778:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947707648:0@lo:101: 00000100:00100000:2.0:1788925270.551846:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.551902:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c84378d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788925270.551963:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947707648 00000100:00100000:3.0:1788925270.551980:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947707648 00000100:00100000:3.0:1788925270.552035:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788925270.552051:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+12:5844:x1875823947707648:12345-0@lo:101: 00010000:00010000:3.0:1788925270.552063:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925270.552076:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c8821c6800/0x503aa1a44b68e507 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e500 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925270.552098:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c8821c6800/0x503aa1a44b68e507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e500 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925270.552108:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c8821c6800/0x503aa1a44b68e507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e500 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925270.552118:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8821c6800, rc 0) 00000100:00100000:3.0:1788925270.552163:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947707648:12345-0@lo:101: Request processed in 120us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925270.552177:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788925270.552313:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947707648:0@lo:101: 00010000:00010000:2.0:1788925270.552325:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c86e444a00/0x503aa1a44b68e500 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e507 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.552334:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c86e444a00/0x503aa1a44b68e500 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e507 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925270.552378:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947707776:0@lo:501: 00000100:00100000:2.0:1788925270.552420:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.552434:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c84378d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788925270.552489:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947707776 00000100:00100000:0.0:1788925270.552505:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947707776 00000100:00100000:0.0:1788925270.552533:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788925270.552539:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947707776:12345-0@lo:501: 00000100:00100000:0.0:1788925270.552764:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947707776:12345-0@lo:501: Request processed in 225us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.552771:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788925270.552840:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947707776:0@lo:501: 00000100:00100000:2.0:1788925270.552863:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947707904:0@lo:503: 00000100:00100000:2.0:1788925270.552894:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.552918:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c84378d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.552929:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947707904 00000100:00100000:2.0:1788925270.552932:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947707904 00000100:00100000:2.0:1788925270.552948:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788925270.552958:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947707904:12345-0@lo:503: 00000100:00100000:2.0:1788925270.553102:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947707904:12345-0@lo:503: Request processed in 144us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.553109:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788925270.553146:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947707904:0@lo:503: 00000100:00100000:2.0:1788925270.553305:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8474:1875823947708032:0@lo:502: 00000100:00100000:2.0:1788925270.553335:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.553350:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947708032 00000100:00100000:2.0:1788925270.553353:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947708032 00000100:00100000:2.0:1788925270.553368:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788925270.553373:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:8474:x1875823947708032:12345-0@lo:502: 00000100:00100000:2.0:1788925270.553516:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:8474:x1875823947708032:12345-0@lo:502: Request processed in 142us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.553523:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788925270.553545:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c84378dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.553555:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8474:1875823947708032:0@lo:502: 00000100:00100000:2.0:1788925270.553585:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8474:1875823947708160:0@lo:502: 00000100:00100000:2.0:1788925270.553610:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.553625:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947708160 00000100:00100000:2.0:1788925270.553628:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947708160 00000100:00100000:2.0:1788925270.553642:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788925270.553646:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:8474:x1875823947708160:12345-0@lo:502: 00000100:00100000:2.0:1788925270.553760:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:8474:x1875823947708160:12345-0@lo:502: Request processed in 113us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.553766:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788925270.553796:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c84378dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.553807:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8474:1875823947708160:0@lo:502: 00000040:00080000:2.0:1788925270.553824:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788925270.553871:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788925270.553883:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788925270.553891:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c86e444a00/0x503aa1a44b68e500 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e507 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.553900:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c86e444a00/0x503aa1a44b68e500 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e507 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925270.553909:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788925270.553911:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788925270.553914:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788925270.553931:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c86e444200/0x503aa1a44b68e50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.553937:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c86e444200/0x503aa1a44b68e50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.553945:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c86e444200/0x503aa1a44b68e50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925270.553955:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947708288:0@lo:101: 00000100:00100000:2.0:1788925270.553978:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.553990:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c84378dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.554001:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947708288 00000100:00100000:2.0:1788925270.554004:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947708288 00000100:00100000:2.0:1788925270.554020:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788925270.554025:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+13:5844:x1875823947708288:12345-0@lo:101: 00010000:00010000:2.0:1788925270.554038:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925270.554048:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c86e445e00/0x503aa1a44b68e515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e50e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.554064:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c86e445e00/0x503aa1a44b68e515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e50e expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.554073:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c86e445e00/0x503aa1a44b68e515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e50e expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.554081:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e445e00, rc 0) 00000100:00100000:2.0:1788925270.554108:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947708288:12345-0@lo:101: Request processed in 83us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.554114:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788925270.554140:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947708288:0@lo:101: 00010000:00010000:2.0:1788925270.554150:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c86e444200/0x503aa1a44b68e50e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e515 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.554158:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c86e444200/0x503aa1a44b68e50e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e515 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925270.554191:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947708416:0@lo:501: 00000100:00100000:2.0:1788925270.554213:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.554225:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c84378dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.554235:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947708416 00000100:00100000:2.0:1788925270.554238:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947708416 00000100:00100000:2.0:1788925270.554253:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788925270.554258:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947708416:12345-0@lo:501: 00000100:00100000:2.0:1788925270.554462:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947708416:12345-0@lo:501: Request processed in 203us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.554469:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788925270.554493:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947708416:0@lo:501: 00000100:00100000:2.0:1788925270.554526:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947708544:0@lo:503: 00000100:00100000:2.0:1788925270.554555:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.554566:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c84378dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.554576:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947708544 00000100:00100000:2.0:1788925270.554579:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947708544 00000100:00100000:2.0:1788925270.554595:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788925270.554601:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947708544:12345-0@lo:503: 00000100:00100000:2.0:1788925270.554707:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947708544:12345-0@lo:503: Request processed in 106us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.554712:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788925270.554755:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947708544:0@lo:503: 00000100:00100000:2.0:1788925270.554970:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8475:1875823947708672:0@lo:502: 00000100:00100000:2.0:1788925270.555001:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.555020:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947708672 00000100:00100000:2.0:1788925270.555023:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947708672 00000100:00100000:2.0:1788925270.555039:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788925270.555045:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:8475:x1875823947708672:12345-0@lo:502: 00000100:00100000:2.0:1788925270.555152:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:8475:x1875823947708672:12345-0@lo:502: Request processed in 106us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.555159:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788925270.555184:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847f763c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.555200:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8475:1875823947708672:0@lo:502: 00000020:01000000:2.0:1788925270.555217:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925270.555224:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925270.555227:0:8475:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788925270.555233:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788925270.555251:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8475:1875823947708800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925270.555280:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.555296:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947708800 00000100:00100000:2.0:1788925270.555299:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947708800 00000100:00100000:2.0:1788925270.555314:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788925270.555319:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:8475:x1875823947708800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925270.555436:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:8475:x1875823947708800:12345-0@lo:502:llog_process_th.0 Request processed in 116us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.555443:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788925270.555468:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847f763c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.555479:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8475:1875823947708800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788925270.555495:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925270.555499:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925270.555501:0:8475:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788925270.555504:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788925270.555537:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788925270.555554:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788925270.555561:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c86e444200/0x503aa1a44b68e50e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e515 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.555569:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c86e444200/0x503aa1a44b68e50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e515 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925270.555589:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788925270.555591:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c87599a800 from 39 10000000:01000000:2.0:1788925270.555594:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788925270.555611:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c86e445400/0x503aa1a44b68e51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.555618:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c86e445400/0x503aa1a44b68e51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.555626:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c86e445400/0x503aa1a44b68e51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925270.555637:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947708928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788925270.555659:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925270.556214:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947708928 00000100:00100000:0.0:1788925270.556219:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947708928 00000100:00100000:0.0:1788925270.556240:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788925270.556246:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+14:5844:x1875823947708928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925270.556254:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925270.556266:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c846cbe200/0x503aa1a44b68e523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e51c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925270.556283:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c846cbe200/0x503aa1a44b68e523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e51c expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925270.556300:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c846cbe200/0x503aa1a44b68e523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e51c expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925270.556307:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c846cbe200, rc 0) 00000100:00100000:3.0:1788925270.569416:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847f763c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925270.570646:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947708928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 14393us (14979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.570657:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788925270.585609:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947708928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925270.585641:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c86e445400/0x503aa1a44b68e51c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e523 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925270.585654:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c86e445400/0x503aa1a44b68e51c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e523 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925270.585905:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947709056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.585963:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.586017:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff173c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.586574:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947709056 00000100:00100000:2.0:1788925270.586582:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947709056 00000100:00100000:2.0:1788925270.586629:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788925270.586638:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947709056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925270.586934:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947709056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.586942:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788925270.588434:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947709056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.588487:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947709184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.588559:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.588599:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff173c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925270.588660:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947709184 00000100:00100000:0.0:1788925270.588667:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947709184 00000100:00100000:0.0:1788925270.588707:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788925270.588715:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947709184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925270.588893:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947709184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.588901:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788925270.589257:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947709184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.589590:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8476:1875823947709312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925270.589625:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.589655:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17300 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.589691:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947709312 00000100:00100000:2.0:1788925270.589696:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947709312 00000100:00100000:2.0:1788925270.589740:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788925270.589747:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:8476:x1875823947709312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925270.589947:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:8476:x1875823947709312:12345-0@lo:502:llog_process_th.0 Request processed in 200us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.589963:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788925270.590540:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8476:1875823947709312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925270.590587:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8476:1875823947709440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925270.590623:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.590647:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17300 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.590897:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947709440 00000100:00100000:2.0:1788925270.590903:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947709440 00000100:00100000:2.0:1788925270.590936:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788925270.590943:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:8476:x1875823947709440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925270.591138:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:8476:x1875823947709440:12345-0@lo:502:llog_process_th.0 Request processed in 195us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.591145:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788925270.591262:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8476:1875823947709440:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788925270.591285:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788925270.595165:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788925270.595212:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788925270.595227:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c86e445400/0x503aa1a44b68e51c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e523 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.595240:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c86e445400/0x503aa1a44b68e51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e523 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925270.595250:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788925270.595253:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788925270.595256:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788925270.595300:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c86e444e00/0x503aa1a44b68e52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.595309:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c86e444e00/0x503aa1a44b68e52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.595321:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c86e444e00/0x503aa1a44b68e52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925270.595346:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947709568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788925270.595460:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.595654:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847f76a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788925270.599174:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947709568 00000100:00100000:0.0:1788925270.599190:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947709568 00000100:00100000:0.0:1788925270.599246:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788925270.599255:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+15:5844:x1875823947709568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925270.599272:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925270.599289:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c846cbfe00/0x503aa1a44b68e531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e52a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925270.599315:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c846cbfe00/0x503aa1a44b68e531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e52a expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925270.599335:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c846cbfe00/0x503aa1a44b68e531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e52a expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925270.599345:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c846cbfe00, rc 0) 00000100:00100000:0.0:1788925270.599430:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947709568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.599437:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788925270.602844:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947709568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925270.602874:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c86e444e00/0x503aa1a44b68e52a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e531 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.602888:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c86e444e00/0x503aa1a44b68e52a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e531 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925270.602973:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947709696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925270.603034:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.603089:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847f76a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788925270.603652:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947709696 00000100:00100000:0.0:1788925270.603661:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947709696 00000100:00100000:0.0:1788925270.603701:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788925270.603710:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947709696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925270.604003:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947709696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.604011:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788925270.606297:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947709696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925270.606351:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947709824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925270.606443:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.606488:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847f76a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788925270.607475:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947709824 00000100:00100000:0.0:1788925270.607485:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947709824 00000100:00100000:0.0:1788925270.607549:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788925270.607558:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947709824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925270.607766:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947709824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.607774:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788925270.608861:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947709824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.621276:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8478:1875823947709952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925270.621366:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.621622:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17300 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.623685:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947709952 00000100:00100000:2.0:1788925270.623697:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947709952 00000100:00100000:2.0:1788925270.623764:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788925270.623774:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:8478:x1875823947709952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925270.624037:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:8478:x1875823947709952:12345-0@lo:502:llog_process_th.0 Request processed in 264us (2670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.624143:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788925270.624245:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8478:1875823947709952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788925270.624279:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925270.624288:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925270.624290:0:8478:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788925270.624295:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788925270.624326:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8478:1875823947710080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925270.624366:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.624426:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17300 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.624599:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947710080 00000100:00100000:2.0:1788925270.624610:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947710080 00000100:00100000:2.0:1788925270.624641:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788925270.624649:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:8478:x1875823947710080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925270.624784:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:8478:x1875823947710080:12345-0@lo:502:llog_process_th.0 Request processed in 136us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.624791:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788925270.624903:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8478:1875823947710080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788925270.624923:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925270.624927:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925270.624929:0:8478:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788925270.624932:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788925270.625198:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788925270.625224:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788925270.625234:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c86e444e00/0x503aa1a44b68e52a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e531 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.625244:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c86e444e00/0x503aa1a44b68e52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e531 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925270.625255:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788925270.625258:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98c844c1e800 from 39 10000000:01000000:2.0:1788925270.625261:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788925270.625286:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c86e445a00/0x503aa1a44b68e538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.625295:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c86e445a00/0x503aa1a44b68e538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.625304:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c86e445a00/0x503aa1a44b68e538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925270.625320:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947710208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788925270.625355:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.625460:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847f76000 going to sleep for 11 seconds 00000100:00100000:0.0:1788925270.626670:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947710208 00000100:00100000:0.0:1788925270.626679:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947710208 00000100:00100000:0.0:1788925270.626734:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788925270.626743:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947710208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925270.626755:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925270.626776:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c846cbe800/0x503aa1a44b68e53f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e538 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925270.626801:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c846cbe800/0x503aa1a44b68e53f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e538 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925270.626812:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c846cbe800/0x503aa1a44b68e53f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e538 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925270.626822:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c846cbe800, rc 0) 00000100:00100000:0.0:1788925270.626875:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947710208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.626881:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788925270.626986:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947710208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925270.627002:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c86e445a00/0x503aa1a44b68e538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e53f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925270.627011:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c86e445a00/0x503aa1a44b68e538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e53f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925270.627077:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947710336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.627104:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.627132:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17300 going to sleep for 11 seconds 00000100:00100000:0.0:1788925270.627219:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947710336 00000100:00100000:0.0:1788925270.627223:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947710336 00000100:00100000:0.0:1788925270.627249:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788925270.627255:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947710336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925270.627593:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947710336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.627601:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788925270.627658:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947710336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.627684:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947710464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.627714:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.627743:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17300 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.627793:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947710464 00000100:00100000:2.0:1788925270.627797:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947710464 00000100:00100000:2.0:1788925270.627827:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788925270.627833:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947710464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925270.627968:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947710464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.627977:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788925270.628068:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947710464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.628454:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8481:1875823947710592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925270.628489:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.628609:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788925270.629281:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947710592 00000100:00100000:0.0:1788925270.629287:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947710592 00000100:00100000:0.0:1788925270.632611:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788925270.632630:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:8481:x1875823947710592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925270.632938:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:8481:x1875823947710592:12345-0@lo:502:llog_process_th.0 Request processed in 315us (4447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.632946:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788925270.633100:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8481:1875823947710592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925270.633171:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8481:1875823947710720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925270.633220:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.638216:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c848277d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.638472:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947710720 00000100:00100000:2.0:1788925270.638484:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947710720 00000100:00100000:3.0:1788925270.638670:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788925270.638680:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:8481:x1875823947710720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925270.638968:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:8481:x1875823947710720:12345-0@lo:502:llog_process_th.0 Request processed in 288us (5747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925270.638977:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788925270.639139:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8481:1875823947710720:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788925270.639180:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788925270.639324:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788925270.639340:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788925270.639350:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c86e445a00/0x503aa1a44b68e538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e53f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925270.639360:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c86e445a00/0x503aa1a44b68e538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e53f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925270.639381:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788925270.639384:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788925270.639386:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788925270.639446:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c8821c7c00/0x503aa1a44b68e546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925270.639454:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c8821c7c00/0x503aa1a44b68e546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925270.639463:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c8821c7c00/0x503aa1a44b68e546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925270.639483:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947710848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.639529:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.639549:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.639766:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947710848 00000100:00100000:2.0:1788925270.639771:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947710848 00000100:00100000:2.0:1788925270.639793:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788925270.639800:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947710848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925270.639809:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925270.639821:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c86e445800/0x503aa1a44b68e54d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.639841:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c86e445800/0x503aa1a44b68e54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e546 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.639851:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c86e445800/0x503aa1a44b68e54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e546 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.639859:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e445800, rc 0) 00000100:00100000:2.0:1788925270.639898:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947710848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.639912:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788925270.639977:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947710848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925270.639989:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c8821c7c00/0x503aa1a44b68e546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e54d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925270.639999:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c8821c7c00/0x503aa1a44b68e546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e54d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925270.640039:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947710976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.640075:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.640099:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.640185:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947710976 00000100:00100000:2.0:1788925270.640190:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947710976 00000100:00100000:2.0:1788925270.640207:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788925270.640213:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947710976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925270.640469:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947710976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.640476:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788925270.640605:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947710976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.640631:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947711104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.640671:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.640692:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c87ff17f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.641120:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947711104 00000100:00100000:2.0:1788925270.641125:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947711104 00000100:00100000:2.0:1788925270.641146:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788925270.641151:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947711104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925270.641283:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947711104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.641289:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788925270.641350:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947711104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.645115:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8483:1875823947711232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925270.645204:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925270.645277:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c868b7d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.648196:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947711232 00000100:00100000:2.0:1788925270.648211:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947711232 00000100:00100000:1.0:1788925270.648316:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788925270.648326:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:8483:x1875823947711232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925270.648797:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:8483:x1875823947711232:12345-0@lo:502:llog_process_th.0 Request processed in 471us (3592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925270.648806:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788925270.651982:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8483:1875823947711232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788925270.652051:0:8483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925270.652068:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925270.652070:0:8483:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788925270.652079:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788925270.652126:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8483:1875823947711360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925270.652210:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.652261:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c848277d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788925270.652659:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947711360 00000100:00100000:1.0:1788925270.652667:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947711360 00000100:00100000:1.0:1788925270.652728:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788925270.652739:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:8483:x1875823947711360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925270.652994:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:8483:x1875823947711360:12345-0@lo:502:llog_process_th.0 Request processed in 257us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925270.653002:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788925270.654007:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8483:1875823947711360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788925270.654055:0:8483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925270.654062:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925270.654063:0:8483:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788925270.654069:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788925270.654435:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788925270.654451:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788925270.654461:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c8821c7c00/0x503aa1a44b68e546 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e54d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925270.654472:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c8821c7c00/0x503aa1a44b68e546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e54d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925270.654480:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788925270.654488:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98c844a44d28 from 1 10000000:01000000:1.0:1788925270.654502:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788925270.654534:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c861866200/0x503aa1a44b68e554 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925270.654542:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c861866200/0x503aa1a44b68e554 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925270.654552:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c861866200/0x503aa1a44b68e554 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925270.654570:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947711488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925270.654617:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925270.654651:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c842d26d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.654852:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947711488 00000100:00100000:2.0:1788925270.654858:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947711488 00000100:00100000:2.0:1788925270.654896:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788925270.654904:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947711488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925270.654913:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925270.654924:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c86e445c00/0x503aa1a44b68e55b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.654944:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c86e445c00/0x503aa1a44b68e55b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e554 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.654955:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c86e445c00/0x503aa1a44b68e55b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e554 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925270.654964:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e445c00, rc 0) 00000100:00100000:2.0:1788925270.655008:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947711488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.655014:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788925270.655258:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947711488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925270.655270:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c861866200/0x503aa1a44b68e554 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e55b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925270.655279:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c861866200/0x503aa1a44b68e554 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e55b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925270.655329:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947711616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925270.655354:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925270.655377:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c842d26d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788925270.655434:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947711616 00000100:00100000:2.0:1788925270.655438:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947711616 00000100:00100000:2.0:1788925270.655463:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788925270.655469:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947711616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925270.655887:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947711616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 416us (530us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788925270.655895:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788925270.655959:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947711616:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788925270.655997:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788925270.656004:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c861866200/0x503aa1a44b68e554 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e55b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925270.656023:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c861866200/0x503aa1a44b68e554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e55b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925270.871241:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788925271.354553:0:8515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd58194dd0 20000000:00000080:1.0:1788925271.354571:0:8515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c8514abc00 uarg=0000000000000000 20000000:01000000:1.0:1788925271.357186:0:8515:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788925271.357195:0:8515:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788925271.357200:0:8515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788925271.361764:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788925271.364640:0:8515:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788925271.373820:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788925271.373890:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788925271.373948:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788925271.373966:0:8515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788925271.373987:0:8515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925271.374004:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c85c218200/0x503aa1a44b68e2d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e2d0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925271.374012:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c840031600/0x503aa1a44b68e339 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e332 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925271.374019:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e3fd expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925271.374041:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c840031800/0x503aa1a44b68e4c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e9f expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925271.374049:0:8515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925271.374085:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c840031800/0x503aa1a44b68e4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e9f expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925271.374105:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c840031800/0x503aa1a44b68e4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e9f expref: 9 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925271.374119:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e754e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875823947711744:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788925271.374218:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e3fd expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925271.374227:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e404 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e3fd expref: 18 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925271.374242:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e754a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875823947711872:0@lo:104: 00000100:00100000:0.0:1788925271.374281:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788925271.374319:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c840031600/0x503aa1a44b68e339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e332 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925271.374328:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c840031600/0x503aa1a44b68e339 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e332 expref: 18 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925271.374335:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875823947712000:0@lo:104: 00000100:00100000:0.0:1788925271.374359:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788925271.374392:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c85c218200/0x503aa1a44b68e2d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e2d0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925271.374423:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c85c218200/0x503aa1a44b68e2d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e2d0 expref: 18 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925271.374431:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e755180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875823947712128:0@lo:104: 00000100:00100000:0.0:1788925271.374449:0:8515:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925271.374682:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788925271.374702:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925271.374745:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947711872 00000100:00100000:2.0:1788925271.374751:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947711872 00000100:00100000:2.0:1788925271.374787:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947712000 00000100:00100000:2.0:1788925271.374790:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947712000 00000100:00100000:2.0:1788925271.374800:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947712128 00000100:00100000:2.0:1788925271.374802:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947712128 00000100:00100000:2.0:1788925271.374814:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788925271.374822:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+5:8515:x1875823947711872:12345-0@lo:104: 00010000:00010000:2.0:1788925271.374833:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e404 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925271.374887:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788925271.374892:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+5:8515:x1875823947711872:12345-0@lo:104: Request processed in 71us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925271.374898:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788925271.374916:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788925271.374921:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8776af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+4:8515:x1875823947712000:12345-0@lo:104: 00010000:00010000:2.0:1788925271.374928:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e339 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925271.374955:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788925271.374961:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8776af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+4:8515:x1875823947712000:12345-0@lo:104: Request processed in 39us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925271.374967:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788925271.374993:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788925271.374999:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:8515:x1875823947712128:12345-0@lo:104: 00010000:00010000:2.0:1788925271.375005:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c861867e00/0x503aa1a44b68e2d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e2d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925271.375043:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788925271.375048:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:8515:x1875823947712128:12345-0@lo:104: Request processed in 50us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925271.375055:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788925271.375111:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788925271.375118:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e404 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375125:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8821c6200 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925271.375128:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e404 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375135:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e404 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925271.375142:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e404 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925271.375147:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788925271.375183:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e404 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375200:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925271.375220:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e404 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375226:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c8821c6200/0x503aa1a44b68e3fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e404 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375239:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788925271.375243:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e339 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375249:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861866c00 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925271.375252:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e339 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375258:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e339 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925271.375264:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e339 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925271.375268:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788925271.375281:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e339 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375286:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925271.375300:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e339 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375307:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c861866c00/0x503aa1a44b68e332 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e339 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375325:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925271.375328:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c861867e00/0x503aa1a44b68e2d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e2d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375334:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861867e00 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925271.375338:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c861867e00/0x503aa1a44b68e2d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e2d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375344:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c861867e00/0x503aa1a44b68e2d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e2d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925271.375351:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c861867e00/0x503aa1a44b68e2d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e2d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925271.375356:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788925271.375368:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c861867e00/0x503aa1a44b68e2d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e2d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375373:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925271.375379:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c861867e00/0x503aa1a44b68e2d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e2d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375384:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c861867e00/0x503aa1a44b68e2d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e2d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375420:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925271.375423:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925271.375425:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925271.375432:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925271.375451:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947712256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925271.375481:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925271.375522:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947712384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925271.375543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925271.375559:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925271.375563:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947712512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925271.375580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925271.375610:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947712256 00000100:00100000:3.0:1788925271.375615:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947712256 00010000:00010000:3.0:1788925271.375635:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e404 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e3fd expref: 19 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925271.375653:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947712384 00000100:00100000:3.0:1788925271.375656:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947712384 00010000:00010000:3.0:1788925271.375666:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c840031600/0x503aa1a44b68e339 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e332 expref: 20 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925271.375676:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947712512 00000100:00100000:3.0:1788925271.375678:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947712512 00010000:00010000:3.0:1788925271.375688:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c85c218200/0x503aa1a44b68e2d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e2d0 expref: 21 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925271.375699:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788925271.375717:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+21:3308:x1875823947712256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788925271.375728:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925271.375733:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e404 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e3fd expref: 21 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375743:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e404 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e3fd expref: 21 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375763:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925271.375793:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+21:3308:x1875823947712256:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925271.375800:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788925271.375813:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788925271.375819:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+20:3305:x1875823947712384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788925271.375826:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925271.375829:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c840031600/0x503aa1a44b68e339 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e332 expref: 20 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375838:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c840031600/0x503aa1a44b68e339 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e332 expref: 20 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375847:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925271.375871:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+20:3305:x1875823947712384:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925271.375877:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788925271.375887:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788925271.375893:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947712512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788925271.375900:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925271.375903:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c85c218200/0x503aa1a44b68e2d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e2d0 expref: 19 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375911:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c85c218200/0x503aa1a44b68e2d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e2d0 expref: 19 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.375919:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925271.375944:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947712512:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925271.375950:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788925271.375986:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947712256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925271.376010:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947712512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925271.376016:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947712384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925271.376779:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c861867c00/0x503aa1a44b68e404 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e3fd expref: 18 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925271.376792:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e754a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875823947711872:0@lo:104: 00010000:00010000:0.0:1788925271.376803:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c840031600/0x503aa1a44b68e339 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e332 expref: 17 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925271.376812:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875823947712000:0@lo:104: 00010000:00010000:0.0:1788925271.376820:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c85c218200/0x503aa1a44b68e2d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e2d0 expref: 16 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925271.376840:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e755180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875823947712128:0@lo:104: 00000100:00100000:0.0:1788925271.386868:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925271.387571:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921469056 00000100:00100000:3.0:1788925271.387581:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921469056 00010000:00010000:3.0:1788925271.387619:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c840031800/0x503aa1a44b68e4c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e9f expref: 10 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925271.387653:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:3.0:1788925271.387663:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921469056:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788925271.387677:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925271.387683:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c840031800/0x503aa1a44b68e4c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e9f expref: 10 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.387700:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c840031800/0x503aa1a44b68e4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e9f expref: 10 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.387739:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.387748:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.387764:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.387787:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.387795:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.387802:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.387808:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbec00 already unused, calling callback (ffffffffc15c6230) 00010000:00010000:3.0:1788925271.387812:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.387820:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.387831:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.387841:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925271.387907:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921469056:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 245us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925271.387914:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00010000:00010000:3.0:1788925271.388376:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c840031800/0x503aa1a44b68e4c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1e9f expref: 9 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925271.388394:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e754e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875823947711744:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788925271.388553:0:8515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.388573:0:8515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.388580:0:8515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.388587:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e562 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925271.895748:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925272.685375:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925272.686859:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925272.686895:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925272.687172:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921469312 00000100:00100000:0.0:1788925272.687191:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921469312 00000100:00100000:0.0:1788925272.687295:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:0.0:1788925272.687310:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921469312:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788925272.687448:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921469312:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 141us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.687460:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:1.0:1788925272.687515:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921469184 00000100:00100000:1.0:1788925272.687530:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921469184 00000100:00080000:0.0:1788925272.687530:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925272.687658:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 173 00000100:00100000:0.0:1788925272.687667:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+9:2360:x1875823921469184:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788925272.687711:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+9:2360:x1875823921469184:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 45us (2345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.687718:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 173 00000100:00100000:3.0:1788925272.687907:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925272.687937:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921469440 00000100:00100000:3.0:1788925272.687942:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921469440 00000100:00100000:3.0:1788925272.688122:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921469568 00000100:00100000:3.0:1788925272.688127:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921469568 00000100:00100000:3.0:1788925272.688148:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:3.0:1788925272.688159:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921469440:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925272.688296:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921469440:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 138us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925272.688303:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:3.0:1788925272.688319:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:3.0:1788925272.688326:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921469568:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925272.688349:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921469568:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925272.688369:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00080000:1.0:1788925272.688624:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788925272.688629:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1788925272.791933:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788925272.791945:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c87ffa4000 from 4 10000000:01000000:1.0:1788925272.791952:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788925272.792020:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925272.792035:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925272.792051:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925272.792089:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947712640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925272.792613:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925272.792702:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847847240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.792769:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947712640 00000100:00100000:0.0:1788925272.792781:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947712640 00000100:00100000:0.0:1788925272.792852:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788925272.792865:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947712640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925272.792885:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925272.792915:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c846cbf000/0x503aa1a44b68e570 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e569 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.792947:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c846cbf000/0x503aa1a44b68e570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e569 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.792979:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c846cbf000/0x503aa1a44b68e570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e569 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.792991:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c846cbf000, rc 0) 00000100:00100000:0.0:1788925272.793047:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947712640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.793055:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788925272.793116:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947712640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925272.793137:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e570 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.793148:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e570 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925272.793230:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947712768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.793261:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925272.793279:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab840 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.793294:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947712768 00000100:00100000:0.0:1788925272.793298:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947712768 00000100:00100000:0.0:1788925272.793324:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788925272.793330:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947712768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.793719:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947712768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 387us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.793728:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788925272.793765:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947712768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.793813:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947712896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.793857:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925272.793873:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab840 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.793886:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947712896 00000100:00100000:0.0:1788925272.793890:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947712896 00000100:00100000:0.0:1788925272.793913:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788925272.793919:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947712896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.794095:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947712896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.794102:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788925272.794141:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947712896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925272.798369:0:8554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8554:1875823947713024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925272.798533:0:8554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925272.798592:0:8554:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847847300 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.803127:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947713024 00000100:00100000:0.0:1788925272.803152:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947713024 00000100:00100000:0.0:1788925272.803250:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788925272.803264:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:8554:x1875823947713024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925272.803655:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:8554:x1875823947713024:12345-0@lo:502:llog_process_th.0 Request processed in 394us (5122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.803665:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788925272.804223:0:8554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8554:1875823947713024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788925272.804275:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925272.804290:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925272.804293:0:8554:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788925272.804301:0:8554:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c87ffa4000 00000020:00000080:1.0:1788925272.804304:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788925272.804446:0:8554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8554:1875823947713152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925272.804505:0:8554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925272.804539:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947713152 00000100:00100000:1.0:1788925272.804545:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947713152 00000100:00100000:1.0:1788925272.804578:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788925272.804586:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:8554:x1875823947713152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925272.804795:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:8554:x1875823947713152:12345-0@lo:502:llog_process_th.0 Request processed in 209us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925272.804803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788925272.804855:0:8554:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c847847300 going to sleep for 11 seconds 00000100:00100000:1.0:1788925272.804870:0:8554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8554:1875823947713152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788925272.804890:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925272.804895:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925272.804897:0:8554:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788925272.804901:0:8554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788925272.807163:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788925272.807212:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788925272.807228:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e570 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.807244:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e570 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925272.807269:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788925272.807272:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c87599a800 from 4 10000000:01000000:0.0:1788925272.807275:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788925272.807326:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.807335:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.807348:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925272.807378:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947713280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.807480:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925272.807538:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.807564:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947713280 00000100:00100000:0.0:1788925272.807572:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947713280 00000100:00100000:0.0:1788925272.807627:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788925272.807638:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947713280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925272.807653:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925272.807669:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c846cbe600/0x503aa1a44b68e57e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e577 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.807709:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c846cbe600/0x503aa1a44b68e57e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e577 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.807722:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c846cbe600/0x503aa1a44b68e57e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e577 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.807744:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c846cbe600, rc 0) 00000100:00100000:0.0:1788925272.807789:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947713280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.807796:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788925272.807854:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947713280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925272.807871:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e57e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.807880:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e57e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925272.808020:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947713408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.808049:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925272.808064:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.808076:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947713408 00000100:00100000:0.0:1788925272.808081:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947713408 00000100:00100000:0.0:1788925272.808106:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788925272.808111:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947713408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.808462:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947713408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.808470:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788925272.808511:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947713408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.808543:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947713536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.808585:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925272.808607:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.808621:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947713536 00000100:00100000:0.0:1788925272.808626:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947713536 00000100:00100000:0.0:1788925272.808648:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788925272.808654:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947713536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.808833:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947713536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.808840:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788925272.808883:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947713536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.810896:0:8556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8556:1875823947713664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925272.813144:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925272.813211:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947713664 00000100:00100000:0.0:1788925272.813222:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947713664 00000100:00100000:0.0:1788925272.813284:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788925272.813295:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:8556:x1875823947713664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925272.823595:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:8556:x1875823947713664:12345-0@lo:502:llog_process_th.0 Request processed in 10286us (10446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.823615:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788925272.823725:0:8556:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.823763:0:8556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8556:1875823947713664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788925272.823816:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925272.823831:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925272.823833:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788925272.823843:0:8556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c87599a800 00000020:00000080:0.0:1788925272.823846:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788925272.823965:0:8556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8556:1875823947713792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925272.824034:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925272.824073:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947713792 00000100:00100000:0.0:1788925272.824081:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947713792 00000100:00100000:0.0:1788925272.824130:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788925272.824144:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:8556:x1875823947713792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925272.824379:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:8556:x1875823947713792:12345-0@lo:502:llog_process_th.0 Request processed in 237us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.824387:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788925272.824455:0:8556:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.824472:0:8556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8556:1875823947713792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788925272.824495:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925272.835119:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925272.835135:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788925272.835151:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788925272.835283:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788925272.835315:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788925272.835334:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e57e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.835349:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e57e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925272.835364:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788925272.835368:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c844c1e800 from 4 10000000:01000000:0.0:1788925272.835371:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788925272.835471:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.835482:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.835509:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925272.835547:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947713920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.835647:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925272.835712:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.835748:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947713920 00000100:00100000:0.0:1788925272.835757:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947713920 00000100:00100000:0.0:1788925272.835821:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788925272.835834:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947713920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925272.835853:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925272.835874:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e58c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e585 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.837814:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e58c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e585 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.837844:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e58c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e585 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.837855:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c846cbec00, rc 0) 00000100:00100000:0.0:1788925272.838776:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947713920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2935us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.838789:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788925272.838895:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947713920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925272.841076:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e58c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.841112:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e58c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925272.841264:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947714048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.841368:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925272.841450:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.841493:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947714048 00000100:00100000:0.0:1788925272.841502:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947714048 00000100:00100000:0.0:1788925272.841552:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788925272.841563:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947714048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.844429:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947714048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2833us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.844448:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788925272.844550:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947714048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.844638:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947714176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925272.849869:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925272.849943:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430ab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788925272.850069:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947714176 00000100:00100000:2.0:1788925272.850084:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947714176 00000100:00100000:2.0:1788925272.850157:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788925272.850169:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947714176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925272.850495:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947714176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 326us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925272.850505:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788925272.850633:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947714176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925272.852221:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8559:1875823947714304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925272.852322:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925272.852361:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c862fd1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.852449:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947714304 00000100:00100000:0.0:1788925272.852458:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947714304 00000100:00100000:0.0:1788925272.852508:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788925272.852520:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:8559:x1875823947714304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925272.852804:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:8559:x1875823947714304:12345-0@lo:502:llog_process_th.0 Request processed in 285us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.852823:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788925272.852888:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8559:1875823947714304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788925272.853562:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925272.853578:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925272.853582:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788925272.853593:0:8559:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c844c1e800 00000020:00000080:0.0:1788925272.853596:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788925272.853739:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8559:1875823947714432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925272.853800:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925272.853837:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947714432 00000100:00100000:0.0:1788925272.853844:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947714432 00000100:00100000:0.0:1788925272.853884:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788925272.853893:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:8559:x1875823947714432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925272.855261:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:8559:x1875823947714432:12345-0@lo:502:llog_process_th.0 Request processed in 1355us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.855279:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788925272.855353:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8430abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788925272.855387:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:8559:1875823947714432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788925272.855472:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925272.855482:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925272.855485:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788925272.855493:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788925272.855578:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788925272.855602:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788925272.855615:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e58c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.855643:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e58c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925272.924643:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925273.389328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925273.392798:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921469696 00000100:00100000:2.0:1788925273.392818:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921469696 00000100:00100000:2.0:1788925273.393848:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 189 00000100:00100000:2.0:1788925273.393873:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+9:5606:x1875823921469696:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925273.393911:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925273.393937:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c86e444400/0x503aa1a44b68e593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1ede expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925273.393982:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c86e444400/0x503aa1a44b68e593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ede expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925273.394149:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c86e444400/0x503aa1a44b68e593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ede expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925273.394162:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e444400, rc 0) 00000100:00100000:2.0:1788925273.394258:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921469696:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 396us (4944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925273.394267:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 189 00000100:00100000:0.0:1788925273.402370:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925273.402437:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921469824 00000100:00100000:0.0:1788925273.403294:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921469824 00000100:00100000:0.0:1788925273.404134:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 190 00000100:00100000:0.0:1788925273.404151:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921469824:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925273.406297:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921469824:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 2136us (3922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925273.406314:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 190 00000100:00100000:0.0:1788925273.415308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925273.415381:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921469952 00000100:00100000:0.0:1788925273.415395:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921469952 00000100:00100000:0.0:1788925273.415483:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 191 00000100:00100000:0.0:1788925273.415495:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921469952:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925273.422367:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921469952:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 6860us (7062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925273.422385:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 191 00000100:00100000:1.0:1788925273.433357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925273.434103:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921470080 00000100:00100000:0.0:1788925273.434119:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921470080 00000100:00100000:0.0:1788925273.434245:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 192 00000100:00100000:0.0:1788925273.434259:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:6136:x1875823921470080:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788925273.434659:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:6136:x1875823921470080:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 401us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925273.434687:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 192 00000100:00100000:2.0:1788925273.445340:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925273.445508:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921470208 00000100:00100000:3.0:1788925273.445523:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921470208 00000100:00100000:3.0:1788925273.445581:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 193 00000100:00100000:3.0:1788925273.445591:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:6136:x1875823921470208:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788925273.445948:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:6136:x1875823921470208:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 356us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925273.445958:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 193 00000100:00100000:3.0:1788925273.495895:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947714688:0@lo:400:kworker.0 00000100:00100000:3.0:1788925273.496147:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925273.496265:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947715200:0@lo:400:kworker.0 00000100:00100000:3.0:1788925273.496300:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925273.496341:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788925273.496348:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947714560:0@lo:400:kworker.0 00000100:00100000:3.0:1788925273.496383:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925273.496452:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947715072:0@lo:400:kworker.0 00000100:00100000:3.0:1788925273.496476:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925273.501880:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947714816:0@lo:400:kworker.0 00000100:00100000:3.0:1788925273.502255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925273.502914:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947715200 00000100:00100000:2.0:1788925273.502927:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947715200 00000100:00100000:2.0:1788925273.503158:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788925273.503172:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947715200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925273.503329:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947714688 00000100:00100000:1.0:1788925273.503335:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947714688 00000100:00100000:1.0:1788925273.503365:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947715072 00000100:00100000:1.0:1788925273.503378:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947715072 00000100:00100000:1.0:1788925273.503394:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947714816 00000100:00100000:1.0:1788925273.503395:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947714816 00000100:00100000:1.0:1788925273.503424:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788925273.503431:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947714688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925273.506229:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947715200:12345-0@lo:400:kworker.0 Request processed in 3044us (9911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925273.506247:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947715328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925273.506251:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788925273.506317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925273.506325:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947714944:0@lo:400:kworker.0 00000100:00100000:2.0:1788925273.506357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925273.506379:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788925273.506390:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1788925273.506392:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925273.506427:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00080000:2.0:1788925273.506430:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788925273.506455:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788925273.506469:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947715072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925273.506533:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947715072:12345-0@lo:400:kworker.0 Request processed in 68us (10054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925273.506540:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788925273.506559:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788925273.506565:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788925273.506572:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947714816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925273.506611:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947714816:12345-0@lo:400:kworker.0 Request processed in 39us (4358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925273.506617:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788925273.506824:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947714816:0@lo:400:kworker.0 00000100:00100000:3.0:1788925273.506855:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947714560 00000100:00100000:3.0:1788925273.506862:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947714560 00000100:00100000:2.0:1788925273.507072:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947714944 00000100:00100000:2.0:1788925273.507078:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947714944 00000100:00100000:2.0:1788925273.507120:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788925273.507128:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947714944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925273.507173:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947714944:12345-0@lo:400:kworker.0 Request processed in 47us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925273.507180:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788925273.507211:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947715328 00000100:00100000:2.0:1788925273.507215:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947715328 00000100:00100000:2.0:1788925273.507243:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788925273.507250:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947715328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925273.507287:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925273.507310:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788925273.507319:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3308:x1875823947714560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925273.507328:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947715328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925273.507334:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788925273.507354:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3308:x1875823947714560:12345-0@lo:400:kworker.0 Request processed in 37us (10970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925273.507359:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:2.0:1788925273.507373:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788925273.507396:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482dc700 x1875823947714944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925273.507432:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947714944:0@lo:400:kworker.0 00000100:00100000:3.0:1788925273.508174:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947714560:0@lo:400:kworker.0 00000100:00100000:3.0:1788925273.508195:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947715072:0@lo:400:kworker.0 00010000:00080000:3.0:1788925273.508212:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482de300 x1875823947715200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925273.508223:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947715200:0@lo:400:kworker.0 00010000:00080000:2.0:1788925273.508343:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c86e756d80 x1875823947715328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925273.508363:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947715328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925273.508581:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947714688:12345-0@lo:400:kworker.0 Request processed in 5147us (12433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925273.508594:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788925273.508602:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947714688:0@lo:400:kworker.0 00010000:00010000:3.0:1788925273.942586:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925274.006756:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947715456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925274.006838:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925274.007081:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947715456 00000100:00100000:2.0:1788925274.007091:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947715456 00000100:00100000:2.0:1788925274.007149:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788925274.007160:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947715456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925274.007201:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925274.007261:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947715456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925274.007269:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788925274.007347:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe4000 x1875823947715456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925274.007367:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947715456:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788925274.966939:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925275.991579:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925277.020448:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925277.811858:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925277.811907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925277.811961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925277.811984:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921470336 00000100:00100000:1.0:1788925277.812000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925277.812002:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921470336 00000100:00100000:1.0:1788925277.812039:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921470464 00000100:00100000:1.0:1788925277.812051:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921470464 00000100:00100000:3.0:1788925277.812095:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 195 00000100:00100000:3.0:1788925277.812112:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921470336:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925277.812133:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:1.0:1788925277.812147:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921470464:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925277.812225:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921470336:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 116us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925277.812230:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921470464:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925277.812241:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 195 00000100:00100000:1.0:1788925277.812249:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:1.0:1788925277.812285:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921470592 00000100:00100000:1.0:1788925277.812290:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921470592 00000100:00100000:1.0:1788925277.812327:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921470720 00000100:00100000:1.0:1788925277.812331:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921470720 00000100:00100000:1.0:1788925277.812362:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:1.0:1788925277.812370:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921470592:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925277.812440:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921470592:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 71us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925277.812466:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:1.0:1788925277.812481:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:1.0:1788925277.812488:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921470720:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925277.812523:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921470720:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 36us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925277.812533:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00080000:1.0:1788925277.812559:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788925277.812564:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788925277.812566:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788925278.040137:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925278.614864:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947715584:0@lo:400:kworker.0 00000100:00100000:3.0:1788925278.614987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925278.615067:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947716096:0@lo:400:kworker.0 00000100:00100000:3.0:1788925278.615104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925278.615142:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788925278.615149:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947715712:0@lo:400:kworker.0 00000100:00100000:3.0:1788925278.615173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925278.615190:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947716224:0@lo:400:kworker.0 00000100:00100000:2.0:1788925278.615210:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947716096 00000100:00100000:3.0:1788925278.615218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925278.615225:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947716096 00000100:00100000:3.0:1788925278.615260:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947715840:0@lo:400:kworker.0 00000100:00100000:3.0:1788925278.615287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925278.615319:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925278.615324:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947715968:0@lo:400:kworker.0 00000100:00100000:3.0:1788925278.615346:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925278.615428:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947715584 00000100:00100000:3.0:1788925278.615433:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947715584 00000100:00100000:2.0:1788925278.615433:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947715712 00000100:00100000:2.0:1788925278.615447:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947715712 00000100:00100000:2.0:1788925278.615471:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947715840 00000100:00100000:2.0:1788925278.615474:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947715840 00000100:00100000:3.0:1788925278.615478:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788925278.615491:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3307:x1875823947715584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925278.615498:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788925278.615509:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ceff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947716096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925278.615568:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ceff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947716096:12345-0@lo:400:kworker.0 Request processed in 62us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925278.615591:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788925278.615593:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3307:x1875823947715584:12345-0@lo:400:kworker.0 Request processed in 102us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925278.615602:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788925278.615621:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788925278.615630:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947715712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925278.615640:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947716224 00000100:00100000:3.0:1788925278.615645:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947716224 00000100:00100000:2.0:1788925278.615667:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947715712:12345-0@lo:400:kworker.0 Request processed in 38us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925278.615676:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788925278.615677:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947715968 00000100:00100000:3.0:1788925278.615681:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947715968 00000100:00100000:2.0:1788925278.615693:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788925278.615703:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788925278.615704:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ceff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947715840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925278.615715:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947716224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925278.615749:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ceff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947715840:12345-0@lo:400:kworker.0 Request processed in 48us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925278.615758:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788925278.615762:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947716224:12345-0@lo:400:kworker.0 Request processed in 49us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925278.615772:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788925278.615788:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788925278.615795:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947715968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925278.615824:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947715968:12345-0@lo:400:kworker.0 Request processed in 31us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925278.615830:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788925278.615880:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe6300 x1875823947715968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925278.615897:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947715968:0@lo:400:kworker.0 00000100:00100000:3.0:1788925278.615908:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947715840:0@lo:400:kworker.0 00000100:00100000:3.0:1788925278.615939:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947715712:0@lo:400:kworker.0 00010000:00080000:3.0:1788925278.615959:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ece00 x1875823947716224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925278.615968:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947716224:0@lo:400:kworker.0 00000100:00100000:3.0:1788925278.615977:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947716096:0@lo:400:kworker.0 00000100:00100000:3.0:1788925278.615984:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947715584:0@lo:400:kworker.0 00000100:00080000:2.0:1788925278.616240:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788925278.616245:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788925278.616248:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925278.622086:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925278.622118:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947716352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925278.622224:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925278.622371:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947716352 00000100:00100000:0.0:1788925278.622384:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947716352 00000100:00100000:0.0:1788925278.622495:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788925278.622507:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947716352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925278.622584:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925278.622641:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947716352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925278.622649:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788925278.629009:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c86e755c00 x1875823947716352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925278.629111:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947716352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788925279.063118:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925279.144395:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925279.144456:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947716480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925279.144558:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925279.144737:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947716480 00000100:00100000:2.0:1788925279.144756:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947716480 00000100:00100000:2.0:1788925279.144828:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788925279.144839:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947716480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925279.145169:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925279.145240:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947716480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 402us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925279.145267:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788925279.145383:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ef800 x1875823947716480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925279.145443:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947716480:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788925279.743387:0:8817:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788925280.089101:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925281.115719:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925282.142491:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925282.935574:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925282.935630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925282.935693:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921470848 00000100:00100000:3.0:1788925282.935707:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921470848 00000100:00100000:2.0:1788925282.935769:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921470976 00000100:00100000:2.0:1788925282.935775:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921470976 00000100:00100000:3.0:1788925282.935799:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 197 00000100:00100000:3.0:1788925282.935814:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921470848:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788925282.935834:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:2.0:1788925282.935844:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921470976:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788925282.935999:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921470976:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 154us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925282.936007:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00080000:2.0:1788925282.936037:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925282.938731:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921470848:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 924us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925282.939243:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 197 00000100:00100000:2.0:1788925282.940659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925282.940732:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925282.941258:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921471104 00000100:00100000:3.0:1788925282.941282:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921471104 00000100:00100000:3.0:1788925282.941364:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921471232 00000100:00100000:3.0:1788925282.941367:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921471232 00000100:00100000:3.0:1788925282.941390:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00080000:2.0:1788925282.941422:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788925282.941428:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925282.941440:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2357:x1875823921471104:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:3.0:1788925282.941487:0:6702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x503aa1a44b68e4d6 00000100:00080000:3.0:1788925282.941511:0:6702:0:(import.c:65:import_set_state_nolock()) ffff98c86f88d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788925282.941567:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1788925282.941591:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925282.945516:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+2:2357:x1875823921471104:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 4057us (4841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925282.945535:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1788925282.945579:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:3.0:1788925282.945595:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2357:x1875823921471232:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:3.0:1788925282.945640:0:6702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x503aa1a44b68e4cf 00000100:00080000:3.0:1788925282.945656:0:6702:0:(import.c:65:import_set_state_nolock()) ffff98c86f88e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788925282.945718:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1788925282.945891:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925282.949732:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+2:2357:x1875823921471232:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 4126us (8981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925282.951765:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00010000:00010000:0.0:1788925283.165887:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925283.735813:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947716608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925283.735940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925283.736057:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947716608 00000100:00100000:3.0:1788925283.736068:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947716608 00000100:00100000:3.0:1788925283.736143:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788925283.736156:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947716608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788925283.736211:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925283.736273:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947716608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925283.736282:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788925283.736327:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788925283.736371:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c86e754e00 x1875823947716608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925283.736424:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947716608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925283.738920:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947716864:0@lo:400:kworker.0 00000100:00100000:1.0:1788925283.739023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925283.739077:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788925283.739084:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947716992:0@lo:400:kworker.0 00000100:00100000:1.0:1788925283.739109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925283.739831:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947716736:0@lo:400:kworker.0 00000100:00100000:1.0:1788925283.739873:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925283.739907:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947717248:0@lo:400:kworker.0 00000100:00100000:1.0:1788925283.739933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925283.739956:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925283.739962:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947717120:0@lo:400:kworker.0 00000100:00100000:1.0:1788925283.739983:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925283.740129:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947717248 00000100:00100000:1.0:1788925283.740155:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947717248 00000100:00100000:1.0:1788925283.740227:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788925283.740237:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947717248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925283.740295:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947717248:12345-0@lo:400:kworker.0 Request processed in 60us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925283.740302:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788925283.740326:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947716864 00000100:00100000:1.0:1788925283.740330:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947716864 00000100:00100000:1.0:1788925283.740369:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947716992 00000100:00100000:1.0:1788925283.740374:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947716992 00000100:00100000:1.0:1788925283.740391:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947717120 00000100:00100000:1.0:1788925283.740393:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947717120 00000100:00100000:1.0:1788925283.740428:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788925283.740447:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947716864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925283.740499:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947716864:12345-0@lo:400:kworker.0 Request processed in 65us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925283.740505:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788925283.740518:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788925283.740525:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947716992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925283.740556:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947716992:12345-0@lo:400:kworker.0 Request processed in 32us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925283.740561:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788925283.740744:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788925283.740751:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947717120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925283.740785:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947717120:12345-0@lo:400:kworker.0 Request processed in 35us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925283.740791:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788925283.740921:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788925283.740928:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788925283.740959:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947717120:0@lo:400:kworker.0 00010000:00080000:1.0:1788925283.740972:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87d1b9180 x1875823947717248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925283.741074:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947717248:0@lo:400:kworker.0 00000100:00100000:1.0:1788925283.741110:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947716992:0@lo:400:kworker.0 00000100:00100000:1.0:1788925283.741121:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947716864:0@lo:400:kworker.0 00000100:00100000:2.0:1788925283.741793:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947716736 00000100:00100000:2.0:1788925283.741808:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947716736 00000100:00100000:2.0:1788925283.741893:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788925283.741906:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3308:x1875823947716736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925283.742008:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3308:x1875823947716736:12345-0@lo:400:kworker.0 Request processed in 105us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925283.742017:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788925283.742116:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947716736:0@lo:400:kworker.0 00010000:00010000:3.0:1788925284.189636:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925284.246800:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947717376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925284.246879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925284.247344:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947717376 00000100:00100000:2.0:1788925284.247354:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947717376 00000100:00100000:2.0:1788925284.247420:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788925284.247430:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947717376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925284.247466:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925284.247543:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947717376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925284.247550:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788925284.247616:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ef100 x1875823947717376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925284.247637:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947717376:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788925285.217840:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788925285.325387:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5652db64-8dca-43c9-a8d1-41118f535cbb 00000020:00000080:2.0:1788925285.325395:0:6725:0:(genops.c:885:class_export_put()) final put ffff98c86f888800/5652db64-8dca-43c9-a8d1-41118f535cbb 00000020:00000080:0.0:1788925285.325594:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c86f888800/5652db64-8dca-43c9-a8d1-41118f535cbb for lustre-OST0000 00000020:00000080:0.0:1788925285.325640:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c86f88d000 for lustre-OST0000 00000001:02000400:1.0:1788925286.038891:0:9062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing yml_node 00010000:00010000:0.0:1788925286.236192:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788925286.873022:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5652db64-8dca-43c9-a8d1-41118f535cbb 00000020:00000080:3.0:1788925286.873032:0:7655:0:(genops.c:885:class_export_put()) final put ffff98c874c52000/5652db64-8dca-43c9-a8d1-41118f535cbb 00000020:00000080:1.0:1788925286.873343:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c874c52000/5652db64-8dca-43c9-a8d1-41118f535cbb for lustre-OST0001 00000020:00000080:1.0:1788925286.873438:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c86f88e000 for lustre-OST0001 00010000:00010000:2.0:1788925287.258564:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925288.045499:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925288.045557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925288.045909:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921471488 00000100:00100000:1.0:1788925288.045919:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921471488 00000100:00100000:1.0:1788925288.046058:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:1.0:1788925288.046068:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921471488:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925288.046154:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921471488:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 86us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925288.046161:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:3.0:1788925288.046659:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921471360 00000100:00100000:3.0:1788925288.046665:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921471360 00000100:00100000:3.0:1788925288.046777:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 199 00000100:00100000:3.0:1788925288.046786:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921471360:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925288.046829:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921471360:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 44us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925288.046835:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 199 00000100:00080000:2.0:1788925288.050198:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788925288.279107:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925288.855520:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947717504:0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.855624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925288.855687:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947718016:0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.855726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925288.855760:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925288.855767:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947717888:0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.855792:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925288.855816:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947717632:0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.855838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925288.855855:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947718144:0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.855873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925288.855889:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925288.855894:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947717760:0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.855913:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925288.855951:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947718016 00000100:00100000:1.0:1788925288.855958:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947718016 00000100:00100000:1.0:1788925288.856012:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947717632 00000100:00100000:1.0:1788925288.856016:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947717632 00000100:00100000:1.0:1788925288.856027:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947717760 00000100:00100000:1.0:1788925288.856030:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947717760 00000100:00100000:1.0:1788925288.856045:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788925288.856052:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947718016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.856104:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947718016:12345-0@lo:400:kworker.0 Request processed in 51us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925288.856111:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788925288.856126:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788925288.856132:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947717632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.856178:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947717632:12345-0@lo:400:kworker.0 Request processed in 47us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925288.856184:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788925288.856195:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788925288.856200:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947717760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.856240:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947717760:12345-0@lo:400:kworker.0 Request processed in 39us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925288.856245:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788925288.856267:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947717888 00000100:00100000:1.0:1788925288.856271:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947717888 00000100:00100000:1.0:1788925288.856295:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947718144 00000100:00100000:1.0:1788925288.856298:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947718144 00000100:00100000:1.0:1788925288.856310:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788925288.856315:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947717888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.856343:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947717888:12345-0@lo:400:kworker.0 Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925288.856348:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788925288.856358:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788925288.856364:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947718144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.856388:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947718144:12345-0@lo:400:kworker.0 Request processed in 25us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925288.856430:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788925288.856474:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947717760:0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.856484:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947717632:0@lo:400:kworker.0 00010000:00080000:1.0:1788925288.856495:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482dc700 x1875823947718144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925288.856512:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947718144:0@lo:400:kworker.0 00010000:00080000:1.0:1788925288.856550:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe6300 x1875823947717888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925288.856559:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947717888:0@lo:400:kworker.0 00000100:00100000:1.0:1788925288.856569:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947718016:0@lo:400:kworker.0 00000100:00080000:1.0:1788925288.856588:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788925288.856592:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788925288.856595:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925288.858731:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947717504 00000100:00100000:3.0:1788925288.858748:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947717504 00000100:00100000:3.0:1788925288.858829:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788925288.858841:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947717504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925288.858931:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947717504:12345-0@lo:400:kworker.0 Request processed in 94us (3307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925288.858938:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788925288.859868:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947717504:0@lo:400:kworker.0 00000100:00100000:2.0:1788925288.861433:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788925288.866378:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947718272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925288.867952:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925288.868072:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947718272 00000100:00100000:2.0:1788925288.868081:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947718272 00000100:00100000:2.0:1788925288.868480:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788925288.868492:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947718272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925288.868531:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925288.868600:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947718272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925288.868607:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788925288.868700:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c86e756a00 x1875823947718272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925288.868729:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947718272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788925289.303560:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925289.369880:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925289.369906:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947718400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925289.369977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925289.370091:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947718400 00000100:00100000:2.0:1788925289.370100:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947718400 00000100:00100000:2.0:1788925289.370154:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788925289.370177:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947718400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925289.370215:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925289.370264:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947718400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925289.370272:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788925289.370314:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9eed80 x1875823947718400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925289.370346:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947718400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788925290.331594:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925291.350695:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788925291.639509:0:9255:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.56 00010000:00010000:0.0:1788925292.375842:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925293.169071:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925293.169144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925293.169272:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921471616 00000100:00100000:1.0:1788925293.169289:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921471616 00000100:00100000:1.0:1788925293.169375:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 201 00000100:00100000:1.0:1788925293.169388:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921471616:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925293.169521:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921471616:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 135us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925293.169530:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 201 00000100:00100000:2.0:1788925293.170195:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921471744 00000100:00100000:2.0:1788925293.170205:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921471744 00000100:00080000:1.0:1788925293.170341:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925293.170383:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:2.0:1788925293.170394:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921471744:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788925293.170504:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921471744:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 112us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925293.170511:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00010000:00010000:2.0:1788925293.398693:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925293.978255:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947718528:0@lo:400:kworker.0 00000100:00100000:0.0:1788925293.978373:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925293.978462:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947719040:0@lo:400:kworker.0 00000100:00100000:0.0:1788925293.978500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925293.978542:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925293.978544:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947718656:0@lo:400:kworker.0 00000100:00100000:0.0:1788925293.978551:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947718912:0@lo:400:kworker.0 00000100:00100000:1.0:1788925293.978594:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925293.978618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925293.978632:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947719168:0@lo:400:kworker.0 00000100:00100000:1.0:1788925293.978662:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925293.978686:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788925293.978694:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947718784:0@lo:400:kworker.0 00000100:00100000:0.0:1788925293.978701:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947719040 00000100:00100000:0.0:1788925293.978710:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947719040 00000100:00100000:1.0:1788925293.978723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925293.978750:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947719296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925293.978775:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925293.978793:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947718656 00000100:00100000:0.0:1788925293.978806:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947718656 00000100:00100000:1.0:1788925293.978815:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947718784 00000100:00100000:1.0:1788925293.978821:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947718784 00000100:00100000:0.0:1788925293.978837:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788925293.978850:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947719040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925293.978856:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788925293.978866:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947718656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925293.978923:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947718656:12345-0@lo:400:kworker.0 Request processed in 58us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925293.978930:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947719040:12345-0@lo:400:kworker.0 Request processed in 81us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925293.978936:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788925293.978944:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788925293.978961:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788925293.978970:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947718784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925293.979019:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947718528 00000100:00100000:2.0:1788925293.979024:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947718528 00000100:00100000:2.0:1788925293.979055:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788925293.979061:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947718528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925293.979106:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947718528:12345-0@lo:400:kworker.0 Request processed in 45us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925293.979113:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788925293.979205:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947718784:12345-0@lo:400:kworker.0 Request processed in 236us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925293.985495:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947718912 00000100:00100000:0.0:1788925293.985516:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947718912 00000100:00100000:0.0:1788925293.985586:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947719168 00000100:00100000:0.0:1788925293.985590:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947719168 00000100:00100000:0.0:1788925293.985611:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788925293.985622:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947718912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925293.985742:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947718912:12345-0@lo:400:kworker.0 Request processed in 122us (7125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925293.985750:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788925293.985766:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788925293.985771:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947719168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925293.985801:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947719168:12345-0@lo:400:kworker.0 Request processed in 30us (7139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925293.985807:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788925293.985822:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788925293.985827:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788925293.985830:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788925293.985879:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ef100 x1875823947718912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925293.985897:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947718912:0@lo:400:kworker.0 00000100:00100000:0.0:1788925293.985910:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947718528:0@lo:400:kworker.0 00000100:00100000:0.0:1788925293.985945:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947719040:0@lo:400:kworker.0 00000100:00100000:0.0:1788925293.986193:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947719296 00000100:00100000:0.0:1788925293.986199:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947719296 00000100:00100000:0.0:1788925293.986242:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788925293.986250:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947719296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925293.986289:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925293.986341:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947719296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (7566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925293.986348:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788925293.992428:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788925293.992920:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947718784:0@lo:400:kworker.0 00010000:00080000:1.0:1788925293.992946:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87d3dc000 x1875823947719296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925293.992972:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947719296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925293.992988:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947718656:0@lo:400:kworker.0 00010000:00080000:1.0:1788925293.993021:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ee680 x1875823947719168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925293.993030:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947719168:0@lo:400:kworker.0 00010000:00010000:3.0:1788925294.422713:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788925294.444470:0:9352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.56 00000100:00100000:2.0:1788925294.486673:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788925294.486706:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947719424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925294.486788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925294.486857:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947719424 00000100:00100000:2.0:1788925294.486869:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947719424 00000100:00100000:2.0:1788925294.486932:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788925294.487179:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947719424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925294.487236:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925294.487303:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947719424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 353us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925294.487312:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788925294.487386:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ece00 x1875823947719424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925294.487473:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947719424:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788925295.446545:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925296.471779:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788925297.429346:0:9452:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.56 00010000:00010000:0.0:1788925297.495061:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925298.284911:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925298.284962:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925298.285065:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921472000 00000100:00100000:1.0:1788925298.285082:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921472000 00000100:00100000:1.0:1788925298.285192:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:1.0:1788925298.285207:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921472000:12345-192.168.204.28@tcp:400:kworker.0 00000100:00080000:0.0:1788925298.285257:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925298.285347:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921472000:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 134us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925298.285357:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:3.0:1788925298.285665:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921471872 00000100:00100000:3.0:1788925298.285692:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921471872 00000100:00100000:3.0:1788925298.285738:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 203 00000100:00100000:3.0:1788925298.285746:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921471872:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925298.285802:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921471872:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 57us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925298.285809:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 203 00010000:00010000:1.0:1788925298.522945:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925299.094567:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788925299.094601:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947719552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925299.094656:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947719808:0@lo:400:kworker.0 00000100:00100000:1.0:1788925299.094679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925299.094743:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947720064:0@lo:400:kworker.0 00000100:00100000:2.0:1788925299.094854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925299.094888:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947719936:0@lo:400:kworker.0 00000100:00100000:2.0:1788925299.094889:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947720320:0@lo:400:kworker.0 00000100:00100000:1.0:1788925299.094922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925299.094954:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947719680:0@lo:400:kworker.0 00000100:00100000:1.0:1788925299.094987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925299.095516:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925299.098603:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947720192:0@lo:400:kworker.0 00000100:00100000:1.0:1788925299.098677:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925299.098760:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947719808 00000100:00100000:1.0:1788925299.098767:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947719808 00000100:00100000:1.0:1788925299.098810:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947719936 00000100:00100000:1.0:1788925299.098826:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947719936 00000100:00100000:1.0:1788925299.098853:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947720192 00000100:00100000:1.0:1788925299.098856:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947720192 00000100:00100000:1.0:1788925299.098872:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788925299.098881:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947719808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925299.098937:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947719808:12345-0@lo:400:kworker.0 Request processed in 57us (4084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925299.098944:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788925299.098961:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788925299.098967:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947719936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925299.099004:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947719936:12345-0@lo:400:kworker.0 Request processed in 37us (4082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925299.099010:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788925299.099021:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788925299.099027:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947720192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925299.099077:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947720192:12345-0@lo:400:kworker.0 Request processed in 49us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925299.099083:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788925299.099103:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947719680 00000100:00100000:1.0:1788925299.099108:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947719680 00000100:00100000:1.0:1788925299.099144:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788925299.099151:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c844b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3307:x1875823947719680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925299.099186:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c844b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3307:x1875823947719680:12345-0@lo:400:kworker.0 Request processed in 36us (4197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925299.099192:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:1.0:1788925299.099234:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925299.099333:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947719680:0@lo:400:kworker.0 00000100:00100000:1.0:1788925299.099355:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947720192:0@lo:400:kworker.0 00000100:00100000:1.0:1788925299.099388:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947719936:0@lo:400:kworker.0 00000100:00100000:3.0:1788925299.099619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925299.099649:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947720320 00000100:00100000:3.0:1788925299.099653:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947720320 00000100:00100000:3.0:1788925299.099891:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947720064 00000100:00100000:3.0:1788925299.099895:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947720064 00000100:00100000:3.0:1788925299.099916:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788925299.099923:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947720320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925299.099961:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947720320:12345-0@lo:400:kworker.0 Request processed in 38us (4444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925299.099967:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788925299.099982:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788925299.099988:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947720064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925299.100017:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947720064:12345-0@lo:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925299.100023:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788925299.100040:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788925299.100044:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788925299.100065:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9eed80 x1875823947720064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925299.100076:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947720064:0@lo:400:kworker.0 00010000:00080000:2.0:1788925299.105128:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ece00 x1875823947720320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925299.105149:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947720320:0@lo:400:kworker.0 00000100:00100000:2.0:1788925299.105188:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947719808:0@lo:400:kworker.0 00000100:00100000:2.0:1788925299.106433:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947719552 00000100:00100000:2.0:1788925299.106442:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947719552 00000100:00100000:2.0:1788925299.106629:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788925299.106643:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947719552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925299.106686:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925299.106777:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947719552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (12097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925299.106786:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788925299.106849:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe4a80 x1875823947719552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925299.106872:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947719552:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788925299.314124:0:9500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Tue Sep 8 23:41:37 EDT 2026 00010000:00010000:0.0:1788925299.560686:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925299.607425:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947720448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925299.607513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925299.607554:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947720448 00000100:00100000:2.0:1788925299.607566:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947720448 00000100:00100000:2.0:1788925299.607623:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788925299.607636:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947720448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925299.607688:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925299.607752:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947720448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925299.607760:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788925299.607816:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8777d5880 x1875823947720448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925299.607838:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947720448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925300.567152:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925301.592370:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925302.616163:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925303.405577:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925303.405624:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925303.405881:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921472256 00000100:00100000:2.0:1788925303.405893:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921472256 00000100:00100000:3.0:1788925303.406348:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921472128 00000100:00100000:2.0:1788925303.406351:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:3.0:1788925303.406353:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921472128 00000100:00100000:2.0:1788925303.406363:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921472256:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925303.406381:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 205 00000100:00100000:3.0:1788925303.406387:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921472128:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925303.407699:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921472128:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 1301us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925303.407711:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 205 00000100:00080000:3.0:1788925303.407762:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925303.411890:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921472256:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 5516us (6252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925303.411912:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 57 00010000:00010000:0.0:1788925303.640097:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925304.214593:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947720704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925304.214624:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947720832:0@lo:400:kworker.0 00000100:00100000:1.0:1788925304.214667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925304.214672:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925304.214749:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947720960:0@lo:400:kworker.0 00000100:00100000:0.0:1788925304.214754:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947720576:0@lo:400:kworker.0 00000100:00100000:3.0:1788925304.214788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925304.214800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925304.214855:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947721216:0@lo:400:kworker.0 00000100:00100000:0.0:1788925304.219515:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947721088:0@lo:400:kworker.0 00000100:00100000:0.0:1788925304.219592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925304.219654:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947720576 00000100:00100000:0.0:1788925304.219661:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947720576 00000100:00100000:0.0:1788925304.219716:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788925304.219723:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947720576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925304.219770:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947720576:12345-0@lo:400:kworker.0 Request processed in 47us (4971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925304.219777:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788925304.219807:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947721088 00000100:00100000:0.0:1788925304.219810:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947721088 00000100:00100000:0.0:1788925304.219842:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788925304.219847:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947721088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925304.219874:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947721088:12345-0@lo:400:kworker.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925304.219880:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788925304.219897:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925304.219929:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947720576:0@lo:400:kworker.0 00010000:00080000:0.0:1788925304.219943:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8777d6300 x1875823947721088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925304.219954:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947721088:0@lo:400:kworker.0 00000100:00100000:0.0:1788925304.220007:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947720832 00000100:00100000:0.0:1788925304.220012:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947720832 00000100:00100000:0.0:1788925304.220046:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947720960 00000100:00100000:0.0:1788925304.220049:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947720960 00000100:00100000:0.0:1788925304.221856:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788925304.221876:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947720832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925304.221931:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788925304.221946:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947720960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925304.221953:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947720832:12345-0@lo:400:kworker.0 Request processed in 84us (7285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925304.221961:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788925304.222004:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947720960:12345-0@lo:400:kworker.0 Request processed in 62us (7215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925304.222005:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947720704 00000100:00100000:1.0:1788925304.222013:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788925304.222014:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947720704 00000100:00100000:1.0:1788925304.222048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925304.222053:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788925304.222063:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947720704:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788925304.222104:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925304.222132:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947721216 00000100:00100000:1.0:1788925304.222136:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947721216 00000100:00100000:1.0:1788925304.222171:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788925304.222178:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947721216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925304.222222:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947721216:12345-0@lo:400:kworker.0 Request processed in 44us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925304.222227:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947720832:0@lo:400:kworker.0 00000100:00100000:1.0:1788925304.222240:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788925304.222243:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947721344:0@lo:400:kworker.0 00000100:00080000:1.0:1788925304.222260:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925304.222284:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947721216:0@lo:400:kworker.0 00000100:00100000:2.0:1788925304.222288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925304.222327:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947721344 00000100:00100000:1.0:1788925304.222331:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947721344 00000100:00100000:1.0:1788925304.222367:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788925304.222374:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947721344:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788925304.223262:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925304.223323:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947720704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1260us (8656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925304.223332:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788925304.223381:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c875987800 x1875823947720704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925304.223417:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947720704:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788925304.223451:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788925304.223687:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947721344:12345-0@lo:400:kworker.0 Request processed in 1312us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925304.223694:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788925304.224197:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8777d4e00 x1875823947721344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925304.224210:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947721344:0@lo:400:kworker.0 00000100:00100000:3.0:1788925304.224627:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947720960:0@lo:400:kworker.0 00010000:00010000:3.0:1788925304.663217:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925304.726770:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925304.726808:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947721472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925304.726890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925304.727156:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947721472 00000100:00100000:2.0:1788925304.727164:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947721472 00000100:00100000:2.0:1788925304.727232:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788925304.727242:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947721472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925304.727280:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925304.727342:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947721472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925304.727349:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788925304.727556:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8777d6d80 x1875823947721472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925304.727576:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947721472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788925305.696364:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925306.713890:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925307.735212:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925308.531543:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925308.531616:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925308.531694:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921472384 00000100:00100000:3.0:1788925308.531705:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921472384 00000100:00100000:3.0:1788925308.531763:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 207 00000100:00100000:3.0:1788925308.531773:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921472384:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925308.531847:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921472384:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925308.531855:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 207 00000100:00100000:1.0:1788925308.532322:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921472512 00000100:00100000:1.0:1788925308.532328:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921472512 00000100:00100000:1.0:1788925308.532397:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:1.0:1788925308.532430:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921472512:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925308.532471:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921472512:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 44us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925308.532478:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00080000:0.0:1788925308.532542:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788925308.758870:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925309.334754:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947721600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925309.335043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925309.335441:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947721600 00000100:00100000:2.0:1788925309.335450:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947721600 00000100:00100000:2.0:1788925309.335528:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788925309.335538:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947721600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925309.335578:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788925309.336333:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925309.339725:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947721984:0@lo:400:kworker.0 00000100:00100000:3.0:1788925309.339815:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925309.339861:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925309.339877:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fcc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947722112:0@lo:400:kworker.0 00000100:00100000:3.0:1788925309.339905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925309.339962:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947721984 00000100:00100000:3.0:1788925309.339970:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947721984 00000100:00100000:0.0:1788925309.339972:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947721728:0@lo:400:kworker.0 00000100:00100000:0.0:1788925309.340021:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925309.340039:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947722112 00000100:00100000:3.0:1788925309.340044:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947722112 00000100:00100000:0.0:1788925309.340068:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fcc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947722240:0@lo:400:kworker.0 00000100:00100000:3.0:1788925309.340078:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788925309.340090:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947721984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925309.340102:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925309.340125:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925309.340132:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947721856:0@lo:400:kworker.0 00000100:00100000:3.0:1788925309.340156:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947721984:12345-0@lo:400:kworker.0 Request processed in 68us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925309.340164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925309.340168:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788925309.340185:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947721856 00000100:00100000:3.0:1788925309.340188:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947721856 00000100:00100000:3.0:1788925309.340208:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788925309.340216:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947722112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925309.340216:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947721728 00000100:00100000:0.0:1788925309.340223:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947721728 00000100:00100000:0.0:1788925309.340257:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788925309.340265:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3307:x1875823947721728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925309.341121:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3307:x1875823947721728:12345-0@lo:400:kworker.0 Request processed in 854us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925309.341129:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788925309.341165:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947722240 00000100:00100000:0.0:1788925309.341169:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947722240 00000100:00100000:0.0:1788925309.341200:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788925309.341208:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947722240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925309.341241:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947722240:12345-0@lo:400:kworker.0 Request processed in 35us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925309.341247:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788925309.341281:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947721728:0@lo:400:kworker.0 00010000:00080000:0.0:1788925309.341296:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87fcc1880 x1875823947722240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925309.341308:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fcc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947722240:0@lo:400:kworker.0 00000100:00100000:3.0:1788925309.341337:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947722112:12345-0@lo:400:kworker.0 Request processed in 1120us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925309.341346:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788925309.341363:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788925309.341370:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947721856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925309.341426:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947721856:12345-0@lo:400:kworker.0 Request processed in 57us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925309.341431:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788925309.341448:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925309.341452:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925309.341500:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fcc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947722112:0@lo:400:kworker.0 00000100:00100000:3.0:1788925309.341513:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947721984:0@lo:400:kworker.0 00000100:00100000:0.0:1788925309.341541:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947721856:0@lo:400:kworker.0 00000100:00100000:2.0:1788925309.345606:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947721600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10059us (10553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925309.345620:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788925309.346319:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c875987800 x1875823947721600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925309.346348:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947721600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788925309.785478:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925309.848441:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925309.848482:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947722368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925309.848590:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925309.848873:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947722368 00000100:00100000:3.0:1788925309.848884:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947722368 00000100:00100000:3.0:1788925309.848944:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788925309.848955:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947722368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925309.849002:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925309.849080:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947722368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925309.849088:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788925309.849138:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c875987800 x1875823947722368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925309.849161:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947722368:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925310.817097:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925311.830876:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925312.862723:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925313.644380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925313.644553:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921472640 00000100:00100000:3.0:1788925313.644564:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921472640 00000100:00100000:3.0:1788925313.644616:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 209 00000100:00100000:3.0:1788925313.644627:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921472640:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925313.644705:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921472640:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 79us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925313.644713:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 209 00000100:00100000:0.0:1788925313.658221:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925313.658365:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921472768 00000100:00100000:2.0:1788925313.658376:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921472768 00000100:00100000:2.0:1788925313.658465:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00100000:2.0:1788925313.658475:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921472768:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788925313.658550:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921472768:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925313.658557:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00080000:0.0:1788925313.659152:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788925313.881138:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925314.457391:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947722624:0@lo:400:kworker.0 00000100:00100000:0.0:1788925314.457541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925314.457593:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947723136:0@lo:400:kworker.0 00000100:00100000:0.0:1788925314.457632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925314.457670:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788925314.457676:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947722496:0@lo:400:kworker.0 00000100:00100000:0.0:1788925314.457714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925314.457745:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947723008:0@lo:400:kworker.0 00000100:00100000:0.0:1788925314.457775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925314.457855:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947722624 00000100:00100000:3.0:1788925314.457864:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947722624 00000100:00100000:3.0:1788925314.457906:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947723008 00000100:00100000:3.0:1788925314.457909:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947723008 00000100:00100000:3.0:1788925314.457947:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788925314.457970:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947722624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925314.458089:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947722624:12345-0@lo:400:kworker.0 Request processed in 120us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925314.458097:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788925314.458115:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788925314.458122:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947723008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925314.458467:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947722880:0@lo:400:kworker.0 00000100:00100000:2.0:1788925314.458502:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925314.458528:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925314.458535:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875823947722752:0@lo:400:kworker.0 00000100:00100000:2.0:1788925314.458556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925314.458591:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947722752 00000100:00100000:2.0:1788925314.458595:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947722752 00000100:00100000:2.0:1788925314.458618:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788925314.458624:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875823947722752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925314.458659:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875823947722752:12345-0@lo:400:kworker.0 Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925314.458665:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788925314.458703:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875823947722752:0@lo:400:kworker.0 00000100:00100000:1.0:1788925314.463016:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947723136 00000100:00100000:1.0:1788925314.463030:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947723136 00000100:00100000:1.0:1788925314.463152:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947722880 00000100:00100000:1.0:1788925314.463156:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947722880 00000100:00100000:1.0:1788925314.463181:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788925314.463192:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947723136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925314.465218:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947723136:12345-0@lo:400:kworker.0 Request processed in 2016us (7586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925314.465235:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788925314.465278:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788925314.465292:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947722880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925314.465372:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947722880:12345-0@lo:400:kworker.0 Request processed in 86us (6869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925314.465378:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788925314.465423:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947722496 00000100:00100000:1.0:1788925314.465431:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947722496 00000100:00100000:1.0:1788925314.465477:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788925314.465484:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947722496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925314.465517:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947722496:12345-0@lo:400:kworker.0 Request processed in 35us (7804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925314.465524:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00080000:1.0:1788925314.465582:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87d3dd180 x1875823947722880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925314.465618:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947722880:0@lo:400:kworker.0 00000100:00100000:2.0:1788925314.465962:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947723264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925314.466002:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925314.466847:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947723008:12345-0@lo:400:kworker.0 Request processed in 8721us (9066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925314.466858:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788925314.466893:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788925314.466899:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925314.466903:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925314.468987:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947723264 00000100:00100000:3.0:1788925314.470110:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947723264 00000100:00100000:3.0:1788925314.471129:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788925314.471146:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947723264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788925314.471448:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925314.471972:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947723264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 829us (5966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925314.471982:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788925314.473577:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947723008:0@lo:400:kworker.0 00000100:00100000:0.0:1788925314.473596:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947722624:0@lo:400:kworker.0 00010000:00080000:0.0:1788925314.473610:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87d3ddc00 x1875823947723136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925314.473632:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947723136:0@lo:400:kworker.0 00000100:00100000:0.0:1788925314.473661:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947722496:0@lo:400:kworker.0 00010000:00080000:3.0:1788925314.474280:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8777d7100 x1875823947723264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925314.474611:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947723264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788925314.905394:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925314.966641:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788925314.972239:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947723392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925314.972560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925314.975484:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947723392 00000100:00100000:3.0:1788925314.975504:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947723392 00000100:00100000:3.0:1788925314.975578:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788925314.975589:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947723392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925314.975633:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925314.975723:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947723392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (3163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925314.975729:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788925314.975778:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ece00 x1875823947723392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925314.975800:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947723392:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788925315.926728:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925316.955785:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925317.990378:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925318.767259:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925318.767331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925318.768992:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921473024 00000100:00100000:2.0:1788925318.769013:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921473024 00000100:00100000:2.0:1788925318.769152:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:2.0:1788925318.769164:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921473024:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788925318.769300:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921473024:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 138us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925318.769309:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00080000:0.0:1788925318.769579:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925318.770644:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921472896 00000100:00100000:3.0:1788925318.770661:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921472896 00000100:00100000:3.0:1788925318.770752:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 211 00000100:00100000:3.0:1788925318.770764:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921472896:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925318.770851:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921472896:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 89us (3519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925318.770870:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 211 00010000:00010000:0.0:1788925319.011432:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925319.574827:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fcc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947723904:0@lo:400:kworker.0 00000100:00100000:1.0:1788925319.574828:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fcc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947723776:0@lo:400:kworker.0 00000100:00100000:0.0:1788925319.574968:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fcc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947723520:0@lo:400:kworker.0 00000100:00100000:1.0:1788925319.577187:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925319.577325:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947724288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925319.577396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925319.577486:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947724288 00000100:00100000:1.0:1788925319.577498:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947724288 00000100:00100000:1.0:1788925319.577577:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788925319.577588:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947724288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788925319.577643:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925319.577719:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947724288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925319.577728:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788925319.577944:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8777d5500 x1875823947724288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925319.577969:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947724288:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788925319.578021:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925319.578035:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fcc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947723648:0@lo:400:kworker.0 00000100:00100000:1.0:1788925319.578071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925319.578096:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fcc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947724160:0@lo:400:kworker.0 00000100:00100000:1.0:1788925319.578127:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925319.578170:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947724160 00000100:00100000:1.0:1788925319.578175:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947724160 00000100:00100000:1.0:1788925319.578213:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788925319.578239:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947724160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925319.578284:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947724160:12345-0@lo:400:kworker.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925319.578291:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788925319.578307:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788925319.578330:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87fcc0e00 x1875823947724160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925319.578340:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fcc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947724160:0@lo:400:kworker.0 00000100:00100000:1.0:1788925319.578386:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947723776 00000100:00100000:1.0:1788925319.578391:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947723776 00000100:00100000:1.0:1788925319.578464:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947723648 00000100:00100000:1.0:1788925319.578467:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947723648 00000100:00100000:1.0:1788925319.578487:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788925319.578493:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947723776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925319.578534:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947723776:12345-0@lo:400:kworker.0 Request processed in 42us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925319.578541:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788925319.578553:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788925319.578559:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947723648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925319.578593:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947723648:12345-0@lo:400:kworker.0 Request processed in 34us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925319.578599:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788925319.578620:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925319.578637:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fcc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947723648:0@lo:400:kworker.0 00000100:00100000:1.0:1788925319.578664:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fcc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947723776:0@lo:400:kworker.0 00000100:00100000:0.0:1788925319.583607:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925319.583728:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fcc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947724032:0@lo:400:kworker.0 00000100:00100000:0.0:1788925319.583787:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925319.583877:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947724032 00000100:00100000:0.0:1788925319.583887:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947724032 00000100:00100000:0.0:1788925319.583968:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788925319.583980:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947724032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925319.584050:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947724032:12345-0@lo:400:kworker.0 Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925319.584058:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788925319.584090:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925319.584127:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fcc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947724032:0@lo:400:kworker.0 00000100:00100000:1.0:1788925319.584579:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947723520 00000100:00100000:1.0:1788925319.584586:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947723520 00000100:00100000:1.0:1788925319.584634:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788925319.584642:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947723520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925319.584710:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947723520:12345-0@lo:400:kworker.0 Request processed in 69us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925319.584717:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788925319.587966:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fcc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947723520:0@lo:400:kworker.0 00000100:00100000:3.0:1788925319.588441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925319.595660:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947723904 00000100:00100000:1.0:1788925319.595678:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947723904 00000100:00100000:1.0:1788925319.595781:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788925319.595794:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947723904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925319.595941:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947723904:12345-0@lo:400:kworker.0 Request processed in 148us (7509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925319.595949:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788925319.596174:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87fcc2300 x1875823947723904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925319.596192:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fcc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947723904:0@lo:400:kworker.0 00010000:00010000:3.0:1788925320.022705:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925320.090320:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947724416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925320.090469:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925320.090709:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947724416 00000100:00100000:1.0:1788925320.090717:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947724416 00000100:00100000:1.0:1788925320.090775:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788925320.090785:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947724416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788925320.090828:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925320.091044:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947724416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 259us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925320.091052:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788925320.091727:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ece00 x1875823947724416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925320.091749:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947724416:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788925321.046667:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788925321.283047:0:10229:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34683192 <= 34618625) for LU-18938, skip 360 00010000:00010000:3.0:1788925322.070687:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788925322.918742:0:10277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34683192 < 34486116) for LU-14927, skip 0f 00010000:00010000:0.0:1788925323.098087:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925323.890045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925323.890116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925323.890223:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921473152 00000100:00100000:1.0:1788925323.890234:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921473152 00000100:00100000:1.0:1788925323.890296:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 213 00000100:00100000:1.0:1788925323.890307:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921473152:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925323.890443:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921473152:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 136us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925323.890453:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 213 00000100:00100000:1.0:1788925323.890498:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921473280 00000100:00100000:1.0:1788925323.890503:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921473280 00000100:00100000:1.0:1788925323.890552:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 73 00000100:00100000:1.0:1788925323.890559:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921473280:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925323.890591:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921473280:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 33us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925323.890596:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 73 00000100:00080000:1.0:1788925323.890726:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788925324.124976:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925324.694593:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947724544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925324.694702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925324.694818:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947724544 00000100:00100000:1.0:1788925324.694828:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947724544 00000100:00100000:1.0:1788925324.694885:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788925324.694895:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947724544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788925324.694938:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925324.694984:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947724544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925324.694992:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788925324.695013:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788925324.695046:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c85f9ece00 x1875823947724544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925324.695067:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947724544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925324.700551:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947724800:0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.700629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925324.700676:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925324.700683:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947724928:0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.700706:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925324.700762:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947724800 00000100:00100000:1.0:1788925324.700771:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947724800 00000100:00100000:1.0:1788925324.700820:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947724928 00000100:00100000:1.0:1788925324.700823:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947724928 00000100:00100000:1.0:1788925324.700855:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788925324.700864:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947724800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.700920:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947724800:12345-0@lo:400:kworker.0 Request processed in 57us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925324.700928:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788925324.700947:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788925324.700953:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947724928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.700982:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947724928:12345-0@lo:400:kworker.0 Request processed in 30us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925324.700989:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788925324.701017:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947724672:0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.701048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925324.701074:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947725184:0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.701097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925324.701114:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925324.701118:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947725056:0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.701149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925324.701173:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947724672 00000100:00100000:1.0:1788925324.701177:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947724672 00000100:00100000:1.0:1788925324.701202:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788925324.701208:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947724672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.701239:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947724672:12345-0@lo:400:kworker.0 Request processed in 31us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925324.701244:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788925324.701268:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947725184 00000100:00100000:1.0:1788925324.701271:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947725184 00000100:00100000:1.0:1788925324.701294:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788925324.701299:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947725184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.701327:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947725184:12345-0@lo:400:kworker.0 Request processed in 28us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925324.701332:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788925324.701352:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788925324.701357:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925324.701379:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947724672:0@lo:400:kworker.0 00010000:00080000:1.0:1788925324.701392:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87ccf5500 x1875823947725184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925324.701424:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947725184:0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.701448:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947724928:0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.701457:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947724800:0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.701471:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947725056 00000100:00100000:1.0:1788925324.701473:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947725056 00000100:00100000:1.0:1788925324.701503:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788925324.701508:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947725056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925324.701542:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947725056:12345-0@lo:400:kworker.0 Request processed in 34us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925324.701547:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788925324.701560:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925324.701574:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947725056:0@lo:400:kworker.0 00000001:02000400:3.0:1788925324.871878:0:10325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34683192 < 34681754) for LU-12550, skip 216 00010000:00010000:2.0:1788925325.146952:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925325.207801:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947725312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925325.207894:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925325.208316:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947725312 00000100:00100000:1.0:1788925325.208327:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947725312 00000100:00100000:1.0:1788925325.208382:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788925325.208392:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947725312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788925325.208522:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925325.208572:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947725312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925325.208580:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788925325.208659:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87ccf5f80 x1875823947725312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925325.208679:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947725312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925326.167123:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788925327.108089:0:10374:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g 00010000:00010000:2.0:1788925327.190668:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925328.218445:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925329.015716:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925329.015771:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925329.017013:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921473536 00000100:00100000:0.0:1788925329.017033:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921473536 00000100:00100000:0.0:1788925329.017161:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:0.0:1788925329.017176:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921473536:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788925329.017712:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921473536:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 537us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925329.017722:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:1.0:1788925329.019244:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921473408 00000100:00100000:1.0:1788925329.019261:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921473408 00000100:00100000:1.0:1788925329.019346:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 215 00000100:00100000:1.0:1788925329.019362:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921473408:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925329.019481:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921473408:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 124us (3775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925329.019490:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 215 00000100:00080000:3.0:1788925329.019654:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788925329.191666:0:10422:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 51c 51e 834 00010000:00010000:2.0:1788925329.238646:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925329.814888:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947725440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925329.815005:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925329.815356:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947725440 00000100:00100000:1.0:1788925329.815368:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947725440 00000100:00100000:1.0:1788925329.815477:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788925329.815489:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947725440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788925329.815562:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925329.815704:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947725824:0@lo:400:kworker.0 00000100:00100000:2.0:1788925329.815751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788925329.815862:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788925329.815885:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947725824 00000100:00100000:2.0:1788925329.815890:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947725824 00000100:00100000:2.0:1788925329.815932:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788925329.815940:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947725824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925329.815994:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947725824:12345-0@lo:400:kworker.0 Request processed in 54us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925329.816002:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788925329.816049:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947725568:0@lo:400:kworker.0 00000100:00100000:2.0:1788925329.816089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925329.816119:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788925329.816127:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947725696:0@lo:400:kworker.0 00000100:00100000:2.0:1788925329.816154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925329.816187:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947725568 00000100:00100000:2.0:1788925329.816191:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947725568 00000100:00100000:2.0:1788925329.816221:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788925329.816227:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947725568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925329.816264:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947725568:12345-0@lo:400:kworker.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925329.816269:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:2.0:1788925329.816298:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925329.816342:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947725824:0@lo:400:kworker.0 00000100:00100000:2.0:1788925329.816370:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947725568:0@lo:400:kworker.0 00000100:00100000:2.0:1788925329.816430:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947725696 00000100:00100000:2.0:1788925329.816434:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947725696 00000100:00100000:2.0:1788925329.816461:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788925329.816468:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947725696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925329.816505:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947725696:12345-0@lo:400:kworker.0 Request processed in 37us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925329.816513:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788925329.816542:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947725696:0@lo:400:kworker.0 00000100:00100000:0.0:1788925329.818167:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947726080:0@lo:400:kworker.0 00000100:00100000:0.0:1788925329.818250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925329.818307:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947726080 00000100:00100000:0.0:1788925329.818316:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947726080 00000100:00100000:0.0:1788925329.818381:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788925329.818390:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947726080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925329.818461:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947726080:12345-0@lo:400:kworker.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925329.818470:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788925329.818492:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788925329.818524:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87d3df100 x1875823947726080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925329.818539:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947726080:0@lo:400:kworker.0 00000100:00100000:2.0:1788925329.824829:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788925329.824885:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947725952:0@lo:400:kworker.0 00000100:00100000:2.0:1788925329.825007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925329.825642:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947725952 00000100:00100000:0.0:1788925329.825654:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947725952 00000100:00100000:0.0:1788925329.825764:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788925329.825776:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947725952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925329.825862:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947725952:12345-0@lo:400:kworker.0 Request processed in 87us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925329.825871:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788925329.825962:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925329.826018:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947725952:0@lo:400:kworker.0 00000100:00100000:1.0:1788925329.828176:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947725440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12671us (13154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925329.828197:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788925329.830269:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87ccf7100 x1875823947725440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925329.830307:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947725440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788925330.262757:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925330.326992:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947726208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925330.327108:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925330.327282:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947726208 00000100:00100000:3.0:1788925330.327293:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947726208 00000100:00100000:3.0:1788925330.327363:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788925330.327375:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947726208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925330.327483:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925330.327560:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947726208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925330.327567:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788925330.327669:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87ccf5c00 x1875823947726208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925330.327694:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947726208:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788925331.287086:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788925331.637132:0:10470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 23:42:09 (1788925329) === 00010000:00010000:3.0:1788925332.313916:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925333.337568:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925334.124674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925334.124726:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925334.124749:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921473664 00000100:00100000:0.0:1788925334.124760:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921473664 00000100:00100000:0.0:1788925334.124822:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 217 00000100:00100000:0.0:1788925334.124834:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921473664:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788925334.124905:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921473664:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 73us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925334.124925:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 217 00000100:00100000:0.0:1788925334.125032:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921473792 00000100:00100000:0.0:1788925334.125036:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921473792 00000100:00100000:0.0:1788925334.125098:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00100000:0.0:1788925334.125107:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2358:x1875823921473792:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788925334.125146:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2358:x1875823921473792:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 40us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925334.125154:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00080000:1.0:1788925334.125309:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788925334.363774:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925334.936737:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947726592:0@lo:400:kworker.0 00000100:00100000:0.0:1788925334.936835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925334.936899:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788925334.936906:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947726720:0@lo:400:kworker.0 00000100:00100000:0.0:1788925334.936935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925334.936987:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947726592 00000100:00100000:0.0:1788925334.936995:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947726592 00000100:00100000:0.0:1788925334.937053:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788925334.937062:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947726592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925334.937114:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947726592:12345-0@lo:400:kworker.0 Request processed in 52us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925334.937121:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788925334.937144:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947726720 00000100:00100000:0.0:1788925334.937148:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947726720 00000100:00100000:0.0:1788925334.937176:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788925334.937183:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947726720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925334.937213:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947726720:12345-0@lo:400:kworker.0 Request processed in 31us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925334.937226:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788925334.937244:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788925334.937248:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788925334.937279:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482ddf80 x1875823947726720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925334.937293:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947726720:0@lo:400:kworker.0 00000100:00100000:0.0:1788925334.937306:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947726592:0@lo:400:kworker.0 00000100:00100000:3.0:1788925334.937554:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947726464:0@lo:400:kworker.0 00000100:00100000:3.0:1788925334.937599:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925334.937623:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947726976:0@lo:400:kworker.0 00000100:00100000:3.0:1788925334.937645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925334.937670:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788925334.937677:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947726336:0@lo:400:kworker.0 00000100:00100000:3.0:1788925334.937703:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925334.937723:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947726848:0@lo:400:kworker.0 00000100:00100000:3.0:1788925334.937743:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925334.937774:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947726464 00000100:00100000:3.0:1788925334.937778:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947726464 00000100:00100000:3.0:1788925334.937801:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947726848 00000100:00100000:3.0:1788925334.937804:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947726848 00000100:00100000:3.0:1788925334.937824:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788925334.937829:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947726464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925334.937862:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947726464:12345-0@lo:400:kworker.0 Request processed in 33us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925334.937868:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788925334.937889:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788925334.937895:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947726848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925334.937921:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947726848:12345-0@lo:400:kworker.0 Request processed in 27us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925334.937927:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788925334.937942:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947726976 00000100:00100000:3.0:1788925334.937946:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947726976 00000100:00100000:3.0:1788925334.937982:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788925334.937989:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947726976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925334.938018:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947726976:12345-0@lo:400:kworker.0 Request processed in 30us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925334.938023:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788925334.938042:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925334.938045:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925334.938069:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947726848:0@lo:400:kworker.0 00000100:00100000:3.0:1788925334.938078:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947726464:0@lo:400:kworker.0 00010000:00080000:3.0:1788925334.938087:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8482dd500 x1875823947726976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925334.938095:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947726976:0@lo:400:kworker.0 00000100:00100000:2.0:1788925334.938459:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788925334.938472:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947727104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925334.938521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925334.938559:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947726336 00000100:00100000:2.0:1788925334.938563:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947726336 00000100:00100000:2.0:1788925334.938609:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788925334.938617:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3308:x1875823947726336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925334.938655:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3308:x1875823947726336:12345-0@lo:400:kworker.0 Request processed in 39us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925334.938661:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788925334.938704:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947726336:0@lo:400:kworker.0 00000100:00100000:0.0:1788925334.938761:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947727104 00000100:00100000:0.0:1788925334.938765:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947727104 00000100:00100000:0.0:1788925334.938799:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788925334.938805:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947727104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925334.938844:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925334.938883:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947727104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925334.938889:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788925334.939156:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87fc46d80 x1875823947727104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925334.939172:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947727104:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788925335.382618:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925335.452285:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947727232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925335.452366:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925335.452623:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947727232 00000100:00100000:0.0:1788925335.452634:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947727232 00000100:00100000:3.0:1788925335.453049:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788925335.453060:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947727232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925335.453095:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925335.453151:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947727232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925335.453173:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788925335.453448:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87ccf5500 x1875823947727232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925335.453468:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947727232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925336.407126:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925337.431800:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925338.454721:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788925338.633019:0:10663:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788925339.245056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925339.245177:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925339.248194:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921473920 00000100:00100000:2.0:1788925339.248216:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921473920 00000100:00100000:2.0:1788925339.248327:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 219 00000100:00100000:2.0:1788925339.248341:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2358:x1875823921473920:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925339.249871:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2358:x1875823921473920:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 1522us (4683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925339.249886:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 219 00000100:00100000:0.0:1788925339.255243:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921474048 00000100:00100000:0.0:1788925339.255260:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921474048 00000100:00100000:0.0:1788925339.255795:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:0.0:1788925339.255812:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2358:x1875823921474048:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788925339.255924:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2358:x1875823921474048:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 119us (10880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925339.255947:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00080000:3.0:1788925339.264946:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788925339.479008:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925340.054898:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947727488:0@lo:400:kworker.0 00000100:00100000:2.0:1788925340.054970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925340.055033:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947727360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925340.055064:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925340.055086:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947728000:0@lo:400:kworker.0 00000100:00100000:2.0:1788925340.055139:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925340.055168:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788925340.055174:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947727616:0@lo:400:kworker.0 00000100:00100000:2.0:1788925340.055198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925340.055216:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947728128:0@lo:400:kworker.0 00000100:00100000:2.0:1788925340.055239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925340.055757:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947727488 00000100:00100000:0.0:1788925340.055766:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947727488 00000100:00100000:0.0:1788925340.055830:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788925340.055839:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3307:x1875823947727488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925340.062413:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947727744:0@lo:400:kworker.0 00000100:00100000:0.0:1788925340.067995:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3307:x1875823947727488:12345-0@lo:400:kworker.0 Request processed in 12144us (13012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925340.068011:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788925340.074707:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947727488:0@lo:400:kworker.0 00000100:00100000:2.0:1788925340.074768:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947727872:0@lo:400:kworker.0 00000100:00100000:2.0:1788925340.075076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925340.075173:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947727360 00000100:00100000:2.0:1788925340.075182:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947727360 00000100:00100000:2.0:1788925340.075244:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788925340.075266:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947727360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925340.075302:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925340.075349:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947727360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (20284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925340.075355:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788925340.075393:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947728000 00000100:00100000:2.0:1788925340.075425:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947728000 00000100:00100000:2.0:1788925340.075972:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947727616 00000100:00100000:2.0:1788925340.075977:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947727616 00000100:00100000:2.0:1788925340.076007:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788925340.076014:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947728000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925340.076056:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947728000:12345-0@lo:400:kworker.0 Request processed in 43us (20925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925340.076062:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788925340.076086:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788925340.076092:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947727616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925340.076121:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947727616:12345-0@lo:400:kworker.0 Request processed in 29us (20922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925340.076177:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788925340.076299:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788925340.081426:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788925340.081439:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925340.085507:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947728128 00000100:00100000:0.0:1788925340.085653:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947728128 00000100:00080000:0.0:1788925340.085760:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788925340.085810:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947727872 00000100:00100000:0.0:1788925340.085814:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947727872 00000100:00100000:0.0:1788925340.085833:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788925340.085840:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947728128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925340.085925:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947728128:12345-0@lo:400:kworker.0 Request processed in 85us (30685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925340.085932:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788925340.085948:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788925340.085953:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947727872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925340.085988:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947727872:12345-0@lo:400:kworker.0 Request processed in 35us (10913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925340.085993:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788925340.086030:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c862fe4a80 x1875823947727872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925340.086045:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c862fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947727872:0@lo:400:kworker.0 00000100:00100000:2.0:1788925340.089676:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947727744 00000100:00100000:2.0:1788925340.089691:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947727744 00000100:00100000:2.0:1788925340.089768:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788925340.089779:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947727744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925340.089892:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947727744:12345-0@lo:400:kworker.0 Request processed in 115us (13593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925340.089899:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788925340.089964:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947727616:0@lo:400:kworker.0 00010000:00080000:2.0:1788925340.089983:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87534c380 x1875823947728128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925340.089994:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947728128:0@lo:400:kworker.0 00010000:00080000:2.0:1788925340.090007:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87ccf5180 x1875823947727360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925340.090022:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947727360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925340.090035:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947728000:0@lo:400:kworker.0 00000100:00100000:2.0:1788925340.090077:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947727744:0@lo:400:kworker.0 00000100:00080000:0.0:1788925340.090494:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788925340.505439:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925340.567927:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925340.567952:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947728256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925340.568024:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925340.568350:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947728256 00000100:00100000:2.0:1788925340.568369:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947728256 00000100:00100000:2.0:1788925340.568757:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788925340.568773:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947728256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925340.568914:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925340.568981:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947728256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 209us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925340.568989:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788925340.569076:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87534f480 x1875823947728256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925340.569096:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947728256:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788925341.526892:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925342.550656:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925343.574649:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925344.363664:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925344.363720:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925344.363847:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921474304 00000100:00100000:1.0:1788925344.363859:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921474304 00000100:00100000:1.0:1788925344.363946:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 89 00000100:00100000:1.0:1788925344.363957:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2358:x1875823921474304:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925344.364053:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2358:x1875823921474304:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 97us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925344.364061:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 89 00000100:00080000:0.0:1788925344.364296:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925344.364535:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921474176 00000100:00100000:2.0:1788925344.364550:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921474176 00000100:00100000:2.0:1788925344.364585:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 221 00000100:00100000:2.0:1788925344.364592:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2358:x1875823921474176:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788925344.364636:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2358:x1875823921474176:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 44us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925344.364642:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 221 00010000:00010000:0.0:1788925344.599096:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925345.177774:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fcc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947728384:0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.177856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925345.177913:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947728896:0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.177943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925345.177973:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925345.177980:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947728768:0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.178007:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925345.178039:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fcc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947728512:0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.178064:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925345.178083:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947729024:0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.178103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925345.178131:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925345.178137:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fcc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947728640:0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.178160:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925345.178267:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947728384 00000100:00100000:3.0:1788925345.178277:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947728384 00000100:00100000:3.0:1788925345.178326:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788925345.178336:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947728384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.178422:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947728384:12345-0@lo:400:kworker.0 Request processed in 66us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925345.178431:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788925345.178604:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947728896 00000100:00100000:3.0:1788925345.178609:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947728896 00000100:00100000:3.0:1788925345.178644:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947728512 00000100:00100000:3.0:1788925345.178647:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947728512 00000100:00100000:3.0:1788925345.178659:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947728640 00000100:00100000:3.0:1788925345.178661:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947728640 00000100:00100000:3.0:1788925345.178674:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788925345.178680:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947728896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.178713:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947728896:12345-0@lo:400:kworker.0 Request processed in 33us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925345.178719:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788925345.178730:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788925345.178736:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947728512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.178766:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947728512:12345-0@lo:400:kworker.0 Request processed in 31us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925345.178771:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788925345.178782:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788925345.178788:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947728640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.178825:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947728640:12345-0@lo:400:kworker.0 Request processed in 37us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925345.178831:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788925345.178849:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947728768 00000100:00100000:3.0:1788925345.178853:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947728768 00000100:00100000:3.0:1788925345.178878:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947729024 00000100:00100000:3.0:1788925345.178881:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947729024 00000100:00100000:3.0:1788925345.178895:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788925345.178900:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947728768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.178931:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947728768:12345-0@lo:400:kworker.0 Request processed in 29us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925345.178936:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788925345.178948:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788925345.178953:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947729024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.178980:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947729024:12345-0@lo:400:kworker.0 Request processed in 27us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925345.178986:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788925345.179014:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925345.179018:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788925345.179021:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925345.179069:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fcc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947728640:0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.179082:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fcc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947728512:0@lo:400:kworker.0 00010000:00080000:3.0:1788925345.179096:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8479bb800 x1875823947729024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925345.179108:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947729024:0@lo:400:kworker.0 00010000:00080000:3.0:1788925345.179150:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c875987800 x1875823947728768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925345.179159:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947728768:0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.179166:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fcc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947728384:0@lo:400:kworker.0 00000100:00100000:3.0:1788925345.179391:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947728896:0@lo:400:kworker.0 00000100:00100000:2.0:1788925345.179756:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947729152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925345.179797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925345.179922:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947729152 00000100:00100000:1.0:1788925345.179928:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947729152 00000100:00100000:1.0:1788925345.179968:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788925345.179977:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947729152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788925345.180007:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925345.180265:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947729152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 289us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925345.180280:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788925345.183242:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87ccf6d80 x1875823947729152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925345.183272:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947729152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788925345.623016:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925345.687282:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947729280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925345.687369:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925345.687559:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947729280 00000100:00100000:1.0:1788925345.687567:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947729280 00000100:00100000:1.0:1788925345.687623:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788925345.687633:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947729280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788925345.687671:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925345.691911:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947729280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4270us (4533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925345.691926:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788925345.693705:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87534ca80 x1875823947729280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925345.693743:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947729280:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788925346.656679:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925347.670641:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925348.697235:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925349.490184:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925349.490229:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925349.492543:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921474432 00000100:00100000:2.0:1788925349.492558:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921474432 00000100:00100000:2.0:1788925349.492620:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 223 00000100:00100000:2.0:1788925349.492631:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921474432:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788925349.492715:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921474432:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 85us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925349.492723:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 223 00000100:00100000:3.0:1788925349.499670:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921474560 00000100:00100000:3.0:1788925349.499684:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921474560 00000100:00100000:3.0:1788925349.499754:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:3.0:1788925349.499767:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921474560:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925349.499855:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921474560:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 91us (9624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925349.499862:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00080000:3.0:1788925349.499966:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788925349.718554:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925350.294721:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875823947729664:0@lo:400:kworker.0 00000100:00100000:2.0:1788925350.294854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925350.294910:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788925350.294917:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947729536:0@lo:400:kworker.0 00000100:00100000:2.0:1788925350.294939:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925350.294952:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947730048:0@lo:400:kworker.0 00000100:00100000:2.0:1788925350.294972:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925350.295040:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947729408:0@lo:400:kworker.0 00000100:00100000:3.0:1788925350.295072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925350.295102:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947729920:0@lo:400:kworker.0 00000100:00100000:3.0:1788925350.295123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925350.295161:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925350.295166:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947729792:0@lo:400:kworker.0 00000100:00100000:3.0:1788925350.295192:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925350.295223:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947729664 00000100:00100000:3.0:1788925350.295229:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947729664 00000100:00100000:3.0:1788925350.295271:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947729536 00000100:00100000:3.0:1788925350.295273:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947729536 00000100:00100000:3.0:1788925350.295282:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947729920 00000100:00100000:3.0:1788925350.295284:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947729920 00000100:00100000:3.0:1788925350.295311:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788925350.295319:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875823947729664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925350.295367:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875823947729664:12345-0@lo:400:kworker.0 Request processed in 48us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925350.295374:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788925350.295389:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788925350.295394:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947729536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925350.295439:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947729536:12345-0@lo:400:kworker.0 Request processed in 45us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925350.295445:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788925350.295455:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788925350.295461:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947729920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925350.295496:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947729920:12345-0@lo:400:kworker.0 Request processed in 35us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925350.295502:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788925350.295524:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947730048 00000100:00100000:3.0:1788925350.295528:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947730048 00000100:00100000:3.0:1788925350.295554:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947729792 00000100:00100000:3.0:1788925350.295557:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947729792 00000100:00100000:3.0:1788925350.295581:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788925350.295586:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947730048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925350.295675:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947729920:0@lo:400:kworker.0 00000100:00100000:2.0:1788925350.295824:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947729408 00000100:00100000:2.0:1788925350.295828:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947729408 00000100:00100000:2.0:1788925350.295867:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788925350.295874:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947729408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925350.295961:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947730048:12345-0@lo:400:kworker.0 Request processed in 374us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925350.295968:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788925350.295980:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788925350.295986:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c874de7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947729792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925350.296047:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c874de7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947729792:12345-0@lo:400:kworker.0 Request processed in 61us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925350.296052:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788925350.296214:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788925350.296219:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925350.296222:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925350.296248:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947729536:0@lo:400:kworker.0 00010000:00080000:3.0:1788925350.296259:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87534df80 x1875823947730048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925350.296269:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947730048:0@lo:400:kworker.0 00000100:00100000:3.0:1788925350.296277:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875823947729664:0@lo:400:kworker.0 00010000:00080000:0.0:1788925350.296394:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87534f100 x1875823947729792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925350.296432:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947729792:0@lo:400:kworker.0 00000100:00100000:0.0:1788925350.296638:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925350.296650:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947730176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925350.296686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925350.296753:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947730176 00000100:00100000:1.0:1788925350.296758:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947730176 00000100:00100000:1.0:1788925350.296796:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788925350.296805:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947730176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788925350.296833:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925350.296905:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947729408:12345-0@lo:400:kworker.0 Request processed in 1030us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925350.296910:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947729408:0@lo:400:kworker.0 00000100:00100000:2.0:1788925350.296912:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788925350.296961:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947730176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925350.296968:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788925350.299064:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87ccf7b80 x1875823947730176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925350.299086:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947730176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788925350.744909:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925350.806831:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925350.806902:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947730304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925350.806999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925350.807167:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947730304 00000100:00100000:2.0:1788925350.807176:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947730304 00000100:00100000:2.0:1788925350.807229:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788925350.807239:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947730304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925350.807275:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925350.807331:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947730304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925350.807356:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788925350.807696:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87534d880 x1875823947730304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925350.807717:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947730304:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788925351.767171:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925352.794986:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925353.814537:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925354.630514:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925354.630573:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925354.630974:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921474816 00000100:00100000:3.0:1788925354.630985:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921474816 00000100:00100000:3.0:1788925354.631105:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 97 00000100:00100000:3.0:1788925354.631116:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921474816:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925354.631194:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921474816:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 80us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925354.631201:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 97 00000100:00100000:0.0:1788925354.631731:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921474688 00000100:00100000:0.0:1788925354.631737:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921474688 00000100:00100000:0.0:1788925354.631778:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 225 00000100:00100000:0.0:1788925354.631786:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921474688:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788925354.631831:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921474688:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 45us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925354.631838:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 225 00000100:00080000:1.0:1788925354.632076:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788925354.839169:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925355.419296:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875823947730688:0@lo:400:kworker.0 00000100:00100000:2.0:1788925355.419308:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947730432:0@lo:400:kworker.0 00000100:00100000:0.0:1788925355.419576:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947730560:0@lo:400:kworker.0 00000100:00100000:3.0:1788925355.424258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925355.424338:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947731200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925355.424374:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925355.425108:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925355.425153:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947730944:0@lo:400:kworker.0 00000100:00100000:2.0:1788925355.425190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925355.425245:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788925355.425253:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947730816:0@lo:400:kworker.0 00000100:00100000:2.0:1788925355.425284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925355.425338:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947731200 00000100:00100000:2.0:1788925355.425346:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947731200 00000100:00100000:2.0:1788925355.425712:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788925355.425724:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947731200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925355.425765:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925355.425895:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947731200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925355.425904:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788925355.425933:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947730432 00000100:00100000:2.0:1788925355.425938:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947730432 00000100:00100000:2.0:1788925355.425972:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788925355.425981:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947730432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925355.426031:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947730432:12345-0@lo:400:kworker.0 Request processed in 49us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925355.426039:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788925355.426141:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947730688 00000100:00100000:2.0:1788925355.426158:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947730688 00000100:00100000:2.0:1788925355.426191:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947730944 00000100:00100000:2.0:1788925355.426194:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947730944 00000100:00100000:2.0:1788925355.426230:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788925355.426236:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875823947730688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925355.426270:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875823947730688:12345-0@lo:400:kworker.0 Request processed in 35us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925355.426277:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788925355.426290:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788925355.426296:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947730944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925355.426325:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947730944:12345-0@lo:400:kworker.0 Request processed in 29us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925355.426330:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788925355.426350:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947730816 00000100:00100000:2.0:1788925355.426354:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947730816 00000100:00100000:2.0:1788925355.426384:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788925355.426390:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947730816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925355.426439:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947730816:12345-0@lo:400:kworker.0 Request processed in 49us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925355.426445:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788925355.426462:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788925355.426467:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788925355.426579:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87534d180 x1875823947730816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925355.426594:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947730816:0@lo:400:kworker.0 00000100:00100000:2.0:1788925355.426605:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947730432:0@lo:400:kworker.0 00000100:00100000:2.0:1788925355.426627:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947730944:0@lo:400:kworker.0 00010000:00080000:2.0:1788925355.426665:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87ccf4e00 x1875823947731200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925355.426680:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947731200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925355.426692:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875823947730688:0@lo:400:kworker.0 00000100:00100000:0.0:1788925355.431423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925355.431480:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947731072:0@lo:400:kworker.0 00000100:00100000:0.0:1788925355.431523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925355.431796:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947730560 00000100:00100000:0.0:1788925355.431805:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947730560 00000100:00100000:0.0:1788925355.431852:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788925355.431861:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947730560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925355.434020:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947731072 00000100:00100000:1.0:1788925355.434034:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947731072 00000100:00100000:1.0:1788925355.434113:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788925355.434124:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947731072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925355.434212:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947731072:12345-0@lo:400:kworker.0 Request processed in 90us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925355.434219:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788925355.434242:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788925355.436220:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947730560:12345-0@lo:400:kworker.0 Request processed in 55us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925355.436245:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788925355.436335:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947730560:0@lo:400:kworker.0 00010000:00080000:0.0:1788925355.436352:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87534ea00 x1875823947731072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925355.436363:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947731072:0@lo:400:kworker.0 00010000:00010000:2.0:1788925355.866118:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925355.926905:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947731328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925355.927011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925355.927221:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947731328 00000100:00100000:2.0:1788925355.927230:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947731328 00000100:00100000:2.0:1788925355.927292:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788925355.927302:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947731328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925355.927348:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925355.927450:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947731328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925355.927458:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788925355.927674:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87534f100 x1875823947731328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925355.927694:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947731328:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788925356.888958:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925357.910664:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788925358.483904:0:11365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788925358.934688:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925359.741380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925359.741471:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925359.741568:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921474944 00000100:00100000:3.0:1788925359.741579:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921474944 00000100:00100000:3.0:1788925359.741633:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 227 00000100:00100000:3.0:1788925359.741644:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921474944:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925359.741716:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921474944:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 74us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925359.741724:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 227 00000100:00100000:3.0:1788925359.743259:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921475072 00000100:00100000:3.0:1788925359.743269:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921475072 00000100:00100000:3.0:1788925359.743342:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 101 00000100:00100000:3.0:1788925359.743351:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921475072:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925359.743422:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921475072:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 71us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925359.743430:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 101 00000100:00080000:1.0:1788925359.743593:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788925359.964539:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925360.535769:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947731456:0@lo:400:kworker.0 00000100:00100000:3.0:1788925360.535857:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925360.535938:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947731584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925360.535968:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947731456 00000100:00100000:1.0:1788925360.535977:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947731456 00000100:00100000:0.0:1788925360.535980:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925360.536042:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788925360.536122:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947731456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925360.536242:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947731712:0@lo:400:kworker.0 00000100:00100000:2.0:1788925360.536352:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925360.536379:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925360.536386:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947732096:0@lo:400:kworker.0 00000100:00100000:2.0:1788925360.536436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925360.536476:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947731584 00000100:00100000:2.0:1788925360.536480:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947731584 00000100:00100000:2.0:1788925360.536520:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788925360.536527:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947731584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925360.536573:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925360.536606:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947731584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925360.536614:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788925360.536651:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947731840:0@lo:400:kworker.0 00000100:00100000:2.0:1788925360.536676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925360.536694:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788925360.536700:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947731968:0@lo:400:kworker.0 00000100:00100000:2.0:1788925360.536719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925360.536742:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947731712 00000100:00100000:2.0:1788925360.536746:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947731712 00000100:00100000:2.0:1788925360.536770:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947731840 00000100:00100000:2.0:1788925360.536772:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947731840 00000100:00100000:2.0:1788925360.536785:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947731968 00000100:00100000:2.0:1788925360.536788:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947731968 00000100:00100000:2.0:1788925360.536801:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788925360.536806:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947731712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925360.536842:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947731712:12345-0@lo:400:kworker.0 Request processed in 35us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925360.536848:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788925360.536863:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788925360.536869:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947731840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925360.536899:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947731840:12345-0@lo:400:kworker.0 Request processed in 30us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925360.536905:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788925360.536917:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788925360.536923:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947731968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925360.536956:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947731968:12345-0@lo:400:kworker.0 Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925360.536962:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1788925360.536979:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788925360.536983:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788925360.537021:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947731712:0@lo:400:kworker.0 00010000:00080000:2.0:1788925360.537053:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87ccf7800 x1875823947731584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925360.537069:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947731584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925360.537096:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947731968:0@lo:400:kworker.0 00000100:00100000:2.0:1788925360.537104:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947731840:0@lo:400:kworker.0 00000100:00100000:1.0:1788925360.537188:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947731456:12345-0@lo:400:kworker.0 Request processed in 1136us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925360.537198:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788925360.537364:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947732096 00000100:00100000:0.0:1788925360.537370:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947732096 00000100:00100000:0.0:1788925360.537426:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788925360.537444:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947732096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925360.537491:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947731456:0@lo:400:kworker.0 00000100:00100000:0.0:1788925360.537492:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947732096:12345-0@lo:400:kworker.0 Request processed in 57us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925360.537506:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788925360.538379:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788925360.538425:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87534dc00 x1875823947732096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925360.538437:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947732096:0@lo:400:kworker.0 00010000:00010000:3.0:1788925360.982983:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925361.048126:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788925361.048167:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947732224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925361.048246:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925361.048306:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947732224 00000100:00100000:2.0:1788925361.048313:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947732224 00000100:00100000:2.0:1788925361.048585:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788925361.048596:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947732224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925361.048724:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925361.048769:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947732224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925361.048787:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788925361.048838:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87534dc00 x1875823947732224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925361.048859:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947732224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788925362.009945:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788925362.941249:0:11513:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefcf543c0 20000000:00000080:3.0:1788925362.941267:0:11513:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c844bec400 uarg=0000000000000000 20000000:01000000:3.0:1788925362.941301:0:11513:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788925362.941313:0:11513:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788925362.941317:0:11513:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788925362.942564:0:11514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788925362.942816:0:11513:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788925362.962901:0:11513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788925362.963058:0:11513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.963088:0:11513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c846cbf000/0x503aa1a44b68e570 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e569 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.963095:0:11513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c846cbe600/0x503aa1a44b68e57e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e577 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.963101:0:11513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e58c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e585 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.963110:0:11513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c86e444400/0x503aa1a44b68e593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ede expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.963117:0:11513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.963160:0:11513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c86e444400/0x503aa1a44b68e593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ede expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.963180:0:11513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c86e444400/0x503aa1a44b68e593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ede expref: 9 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925362.963194:0:11513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479b9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11513:1875823947732352:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788925362.963677:0:11513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e58c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e585 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.963703:0:11513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e58c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e585 expref: 18 pid: 5839 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925362.963714:0:11513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479b8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11513:1875823947732480:0@lo:104: 00000100:00100000:3.0:1788925362.969706:0:11513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925362.969767:0:7643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947732480 00000100:00100000:3.0:1788925362.969776:0:7643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947732480 00000100:00100000:3.0:1788925362.969838:0:7643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788925362.969848:0:7643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:11513:x1875823947732480:12345-0@lo:104: 00010000:00010000:3.0:1788925362.969867:0:7643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e58c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.969919:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788925362.969925:0:7643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:11513:x1875823947732480:12345-0@lo:104: Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925362.969932:0:7643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1788925362.969955:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925362.969971:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e58c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.969979:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbe400 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925362.969984:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e58c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.969992:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e58c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925362.969998:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e58c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925362.970019:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788925362.970074:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e58c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.970082:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925362.970108:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e58c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.970115:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c846cbe400/0x503aa1a44b68e585 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e58c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.970129:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925362.970131:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925362.970133:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925362.970141:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925362.970155:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947732608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925362.970190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788925362.970243:0:11513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c846cbe600/0x503aa1a44b68e57e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e577 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.970254:0:11513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c846cbe600/0x503aa1a44b68e57e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e577 expref: 18 pid: 5842 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925362.970263:0:11513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479bb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11513:1875823947732736:0@lo:104: 00000100:00100000:3.0:1788925362.970286:0:11513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788925362.970310:0:11513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c846cbf000/0x503aa1a44b68e570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x503aa1a44b68e569 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.970318:0:11513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c846cbf000/0x503aa1a44b68e570 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x503aa1a44b68e569 expref: 18 pid: 5842 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925362.970333:0:11513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11513:1875823947732864:0@lo:104: 00000100:00100000:3.0:1788925362.970355:0:11513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925362.970374:0:7643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947732736 00000100:00100000:3.0:1788925362.970378:0:7643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947732736 00000100:00100000:3.0:1788925362.971073:0:7643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947732864 00000100:00100000:3.0:1788925362.971079:0:7643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947732864 00000100:00100000:3.0:1788925362.971102:0:7643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788925362.971109:0:7643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+4:11513:x1875823947732736:12345-0@lo:104: 00010000:00010000:3.0:1788925362.971119:0:7643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e57e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.971161:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788925362.971167:0:7643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+4:11513:x1875823947732736:12345-0@lo:104: Request processed in 59us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925362.971172:0:7643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788925362.971187:0:7643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788925362.971193:0:7643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:11513:x1875823947732864:12345-0@lo:104: 00010000:00010000:3.0:1788925362.971201:0:7643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e570 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.971233:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788925362.971238:0:7643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+3:11513:x1875823947732864:12345-0@lo:104: Request processed in 46us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925362.971244:0:7643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788925362.971263:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788925362.971267:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e57e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.971287:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbf200 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925362.971291:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e57e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.971299:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e57e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925362.971306:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e57e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925362.971311:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788925362.971329:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e57e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.971336:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925362.971347:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e57e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.971354:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c846cbf200/0x503aa1a44b68e577 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e57e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.971366:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925362.971369:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x503aa1a44b68e570 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.971375:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861867c00 already unused, calling callback (ffffffffc1be3c20) 10000000:00010000:3.0:1788925362.971378:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x503aa1a44b68e570 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.972235:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x503aa1a44b68e570 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925362.972242:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x503aa1a44b68e570 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925362.972248:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788925362.972269:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e570 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.972275:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925362.972302:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e570 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.972308:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff98c861867c00/0x503aa1a44b68e569 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x503aa1a44b68e570 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.972325:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925362.972327:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925362.972329:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925362.972348:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947732992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925362.972548:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947732608 00000100:00100000:0.0:1788925362.972555:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947732608 00010000:00010000:0.0:1788925362.972582:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e58c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e585 expref: 19 pid: 5839 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925362.972609:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788925362.972617:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8478a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947732608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925362.972628:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925362.972634:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e58c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e585 expref: 19 pid: 5839 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925362.972645:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e58c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e585 expref: 19 pid: 5839 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925362.972662:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925362.972710:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8478a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947732608:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925362.972718:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788925362.972766:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925362.972772:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788925362.972781:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947733120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925362.972806:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925362.972843:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947733120 00000100:00100000:0.0:1788925362.972847:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947733120 00010000:00010000:0.0:1788925362.972861:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c846cbf000/0x503aa1a44b68e570 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e569 expref: 19 pid: 5842 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925362.972883:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788925362.972889:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3308:x1875823947733120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925362.972896:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925362.972900:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c846cbf000/0x503aa1a44b68e570 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e569 expref: 19 pid: 5842 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925362.972908:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c846cbf000/0x503aa1a44b68e570 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e569 expref: 19 pid: 5842 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925362.972919:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925362.972945:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3308:x1875823947733120:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925362.972952:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788925362.974236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925362.982378:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925362.982672:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947732608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788925362.982721:0:11513:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c844fbfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925362.982736:0:11513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479b9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11513:1875823947732352:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788925362.982749:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c846cbec00/0x503aa1a44b68e58c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e585 expref: 18 pid: 5839 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925362.982766:0:11513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479b8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11513:1875823947732480:0@lo:104: 00000100:00100000:3.0:1788925362.982773:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947732992 00000100:00100000:2.0:1788925362.982775:0:11513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479bb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11513:1875823947732736:0@lo:104: 00000100:00100000:3.0:1788925362.982780:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947732992 00010000:00010000:2.0:1788925362.982782:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c846cbf000/0x503aa1a44b68e570 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e569 expref: 17 pid: 5842 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925362.982790:0:11513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11513:1875823947732864:0@lo:104: 00010000:00010000:3.0:1788925362.982811:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c846cbe600/0x503aa1a44b68e57e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e577 expref: 17 pid: 5842 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925362.982811:0:11513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925362.982830:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921475200 00000100:00100000:3.0:1788925362.982834:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921475200 00000100:00100000:2.0:1788925362.982842:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788925362.982852:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:3306:x1875823947732992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788925362.982868:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925362.982871:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c86e444400/0x503aa1a44b68e593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ede expref: 10 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925362.982873:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c846cbe600/0x503aa1a44b68e57e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x503aa1a44b68e577 expref: 17 pid: 5842 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925362.982886:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:3.0:1788925362.982891:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921475200:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788925362.982893:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c846cbe600/0x503aa1a44b68e57e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x503aa1a44b68e577 expref: 17 pid: 5842 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.982898:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925362.982901:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c86e444400/0x503aa1a44b68e593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ede expref: 10 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925362.982909:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c846cbe600/0x503aa1a44b68e57e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x503aa1a44b68e577 expref: 17 pid: 5842 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.982914:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c86e444400/0x503aa1a44b68e593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ede expref: 10 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925362.982923:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788925362.982931:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c86e444400/0x503aa1a44b68e593 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ede expref: 10 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.982941:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.982949:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.982962:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.982970:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.982978:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.982985:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925362.982991:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:3306:x1875823947732992:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (8757us total) trans 0 rc 0/0 00010000:00010000:3.0:1788925362.982997:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8821c6400 already unused, calling callback (ffffffffc15c6230) 00000100:00100000:2.0:1788925362.982999:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788925362.983001:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.983009:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.983023:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925362.983043:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925362.983094:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9daa795-437c-4e56-9ebb-89af76979400+9:2360:x1875823921475200:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 201us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925362.983101:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00010000:00010000:2.0:1788925362.983103:0:11513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925362.983111:0:11513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925362.983117:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c8821c6400/0x503aa1a44b68e59a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925362.983837:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947732992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788925362.984622:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947733120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925363.032605:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925364.054945:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788925364.246775:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788925364.246786:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c87ffa4000 from 7 10000000:01000000:1.0:1788925364.246791:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788925364.246911:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c861867a00/0x503aa1a44b68e5a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925364.246930:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c861867a00/0x503aa1a44b68e5a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925364.246943:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c861867a00/0x503aa1a44b68e5a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925364.246972:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947733248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925364.247114:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925364.247305:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c875397cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925364.251982:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947733248 00000100:00100000:3.0:1788925364.252000:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947733248 00000100:00100000:3.0:1788925364.252252:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788925364.252264:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+16:5844:x1875823947733248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925364.252283:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925364.252310:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c8821c6200/0x503aa1a44b68e5a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e5a1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925364.252339:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c8821c6200/0x503aa1a44b68e5a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e5a1 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925364.252350:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c8821c6200/0x503aa1a44b68e5a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e5a1 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925364.252360:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8821c6200, rc 0) 00000100:00100000:3.0:1788925364.252490:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947733248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (5374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925364.252497:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788925364.252593:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947733248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925364.252612:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c861867a00/0x503aa1a44b68e5a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e5a8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925364.252622:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c861867a00/0x503aa1a44b68e5a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e5a8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925364.252715:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947733376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925364.252760:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925364.263379:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c841322900 going to sleep for 11 seconds 00000100:00100000:0.0:1788925364.263996:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947733376 00000100:00100000:0.0:1788925364.264007:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947733376 00000100:00100000:0.0:1788925364.264228:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788925364.264240:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947733376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925364.268418:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947733376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4156us (15632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925364.268434:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788925364.268885:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947733376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925364.268939:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947733504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925364.268988:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925364.269051:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c844fbfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788925364.270137:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947733504 00000100:00100000:0.0:1788925364.270147:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947733504 00000100:00100000:0.0:1788925364.270189:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788925364.270198:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947733504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925364.270431:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947733504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925364.270438:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788925364.271535:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947733504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788925364.274794:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788925364.286469:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788925364.286508:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788925364.286522:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c861867a00/0x503aa1a44b68e5a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e5a8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925364.286535:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c861867a00/0x503aa1a44b68e5a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e5a8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925364.286546:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788925364.286549:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c87599a800 from 7 10000000:01000000:1.0:1788925364.286552:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788925364.286588:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c861867000/0x503aa1a44b68e5af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925364.286596:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c861867000/0x503aa1a44b68e5af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925364.286607:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c861867000/0x503aa1a44b68e5af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925364.287009:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947733632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925364.287100:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925364.287180:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c875397840 going to sleep for 11 seconds 00000100:00100000:3.0:1788925364.291491:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947733632 00000100:00100000:3.0:1788925364.291506:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947733632 00000100:00100000:3.0:1788925364.291558:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788925364.291568:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+17:5844:x1875823947733632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925364.291585:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925364.291603:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e5b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e5af expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925364.291644:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e5b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e5af expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925364.291656:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c8821c7e00/0x503aa1a44b68e5b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e5af expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925364.291665:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8821c7e00, rc 0) 00000100:00100000:3.0:1788925364.291751:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947733632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (4651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925364.291759:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788925364.292145:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947733632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925364.292165:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c861867000/0x503aa1a44b68e5af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e5b6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925364.292176:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c861867000/0x503aa1a44b68e5af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e5b6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925364.292249:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947733760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925364.292285:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925364.292325:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8478f5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925364.292380:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947733760 00000100:00100000:2.0:1788925364.292386:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947733760 00000100:00100000:2.0:1788925364.292445:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788925364.292453:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947733760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925364.293111:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947733760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 657us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925364.293119:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788925364.293231:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947733760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925364.293261:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947733888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925364.293302:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925364.293332:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8478f5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925364.293929:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947733888 00000100:00100000:2.0:1788925364.293936:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947733888 00000100:00100000:2.0:1788925364.293976:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788925364.293984:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947733888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925364.294173:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947733888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925364.294181:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788925364.294312:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947733888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788925364.295782:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788925364.296165:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788925364.296185:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788925364.296197:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c861867000/0x503aa1a44b68e5af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e5b6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925364.296209:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c861867000/0x503aa1a44b68e5af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e5b6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925364.296220:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788925364.296223:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98c844c1e800 from 7 10000000:01000000:0.0:1788925364.296226:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788925364.296264:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c846cbe000/0x503aa1a44b68e5bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925364.296272:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff98c846cbe000/0x503aa1a44b68e5bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925364.296283:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff98c846cbe000/0x503aa1a44b68e5bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925364.296311:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947734016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788925364.296378:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925364.296429:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8478f5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925364.296856:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947734016 00000100:00100000:2.0:1788925364.296864:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947734016 00000100:00100000:2.0:1788925364.296915:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788925364.296925:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+18:5844:x1875823947734016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925364.296938:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925364.296952:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c86e445000/0x503aa1a44b68e5c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x503aa1a44b68e5bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925364.296975:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c86e445000/0x503aa1a44b68e5c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x503aa1a44b68e5bd expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925364.296985:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c86e445000/0x503aa1a44b68e5c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x503aa1a44b68e5bd expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925364.297000:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e445000, rc 0) 00000100:00100000:2.0:1788925364.297068:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947734016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925364.297075:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788925364.297268:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947734016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925364.297283:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff98c846cbe000/0x503aa1a44b68e5bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e5c4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925364.297293:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff98c846cbe000/0x503aa1a44b68e5bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x503aa1a44b68e5c4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925364.297371:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947734144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925364.297419:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925364.297444:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c8478f5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925364.297750:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947734144 00000100:00100000:2.0:1788925364.297756:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947734144 00000100:00100000:2.0:1788925364.297783:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788925364.297789:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947734144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925364.298258:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947734144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 466us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925364.298265:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788925364.301944:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947734144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925364.302008:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947734272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925364.302219:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925364.302273:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c844fbfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925364.303614:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947734272 00000100:00100000:2.0:1788925364.303625:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947734272 00000100:00100000:2.0:1788925364.303698:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788925364.303709:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947734272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925364.303935:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:5844:x1875823947734272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925364.303943:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788925364.304237:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:5844:1875823947734272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788925364.305568:0:11540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788925364.305915:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788925364.305936:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788925364.305947:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff98c846cbe000/0x503aa1a44b68e5bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e5c4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925364.305959:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff98c846cbe000/0x503aa1a44b68e5bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x503aa1a44b68e5c4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925364.785787:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925364.785876:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921475328 00000100:00100000:3.0:1788925364.785886:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921475328 00000100:00100000:3.0:1788925364.785950:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 238 00000100:00100000:3.0:1788925364.785962:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+9:5606:x1875823921475328:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925364.785979:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925364.785997:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c8821c6a00/0x503aa1a44b68e5cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1ee5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925364.786025:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c8821c6a00/0x503aa1a44b68e5cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ee5 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925364.786047:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c8821c6a00/0x503aa1a44b68e5cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ee5 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925364.786057:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8821c6a00, rc 0) 00000100:00100000:3.0:1788925364.786113:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921475328:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 153us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925364.786119:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 238 00000100:00100000:1.0:1788925364.799378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925364.799947:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921475456 00000100:00100000:0.0:1788925364.799958:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921475456 00000100:00100000:0.0:1788925364.800140:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 239 00000100:00100000:0.0:1788925364.800151:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921475456:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925364.801191:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921475456:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 1037us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925364.801202:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 239 00000100:00100000:3.0:1788925364.804182:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925364.804432:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921475584 00000100:00100000:1.0:1788925364.804441:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921475584 00000100:00100000:1.0:1788925364.804499:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 240 00000100:00100000:1.0:1788925364.804510:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921475584:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925364.805099:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:5606:x1875823921475584:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 588us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925364.805108:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 240 00000100:00100000:1.0:1788925364.847018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925364.847112:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921475712 00000100:00100000:2.0:1788925364.847128:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921475712 00000100:00100000:2.0:1788925364.847245:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 105 00000100:00100000:2.0:1788925364.847260:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2358:x1875823921475712:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788925364.847350:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2358:x1875823921475712:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 95us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925364.847358:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 105 00000100:00080000:3.0:1788925364.847509:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788925365.078801:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925365.660983:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823947734656:0@lo:400:kworker.0 00000100:00100000:3.0:1788925365.661087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925365.661145:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788925365.661152:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947734528:0@lo:400:kworker.0 00000100:00100000:3.0:1788925365.661176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925365.661192:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947735040:0@lo:400:kworker.0 00000100:00100000:3.0:1788925365.661213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925365.661255:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947734656 00000100:00100000:3.0:1788925365.661262:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947734656 00000100:00100000:3.0:1788925365.661315:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947734528 00000100:00100000:3.0:1788925365.661319:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947734528 00000100:00100000:3.0:1788925365.661339:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788925365.661346:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823947734656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925365.661397:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823947734656:12345-0@lo:400:kworker.0 Request processed in 51us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925365.661421:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788925365.661439:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788925365.661445:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947734528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925365.661470:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947734528:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925365.661475:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788925365.661492:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925365.661523:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947734528:0@lo:400:kworker.0 00000100:00100000:3.0:1788925365.661533:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823947734656:0@lo:400:kworker.0 00000100:00100000:1.0:1788925365.661795:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947735040 00000100:00100000:1.0:1788925365.661800:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947735040 00000100:00100000:1.0:1788925365.661837:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788925365.661845:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947735040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925365.661881:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947735040:12345-0@lo:400:kworker.0 Request processed in 38us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925365.661886:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788925365.661902:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788925365.662079:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8479b9500 x1875823947735040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925365.662097:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947735040:0@lo:400:kworker.0 00000100:00100000:2.0:1788925365.662211:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947734400:0@lo:400:kworker.0 00000100:00100000:2.0:1788925365.662252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925365.662278:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947734912:0@lo:400:kworker.0 00000100:00100000:2.0:1788925365.662300:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925365.662317:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925365.662323:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8479bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947734784:0@lo:400:kworker.0 00000100:00100000:2.0:1788925365.662342:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925365.662374:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947734912 00000100:00100000:2.0:1788925365.662379:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947734912 00000100:00100000:2.0:1788925365.662434:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788925365.662441:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947734912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925365.662481:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947734912:12345-0@lo:400:kworker.0 Request processed in 40us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925365.662487:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788925365.662511:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947734400 00000100:00100000:2.0:1788925365.662515:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947734400 00000100:00100000:2.0:1788925365.662538:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788925365.662544:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3308:x1875823947734400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925365.662590:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3308:x1875823947734400:12345-0@lo:400:kworker.0 Request processed in 47us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925365.662596:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788925365.662621:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947734784 00000100:00100000:2.0:1788925365.662625:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947734784 00000100:00100000:2.0:1788925365.662648:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788925365.662655:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947734784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925365.662696:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947734784:12345-0@lo:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925365.662702:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788925365.662728:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8479bb480 x1875823947734784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925365.662738:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947734784:0@lo:400:kworker.0 00000100:00100000:2.0:1788925365.662746:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947734400:0@lo:400:kworker.0 00000100:00100000:2.0:1788925365.662755:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8479b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947734912:0@lo:400:kworker.0 00000100:00080000:2.0:1788925365.662779:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788925365.662783:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925365.667448:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788925365.667473:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947735168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925365.667545:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925365.667608:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947735168 00000100:00100000:0.0:1788925365.667616:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947735168 00000100:00100000:0.0:1788925365.667662:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788925365.667671:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947735168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925365.667721:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925365.667767:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947735168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925365.667774:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788925365.667815:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87fc47100 x1875823947735168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925365.667834:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947735168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788925366.105532:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925366.167593:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87534f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947735296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925366.167677:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925366.167794:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947735296 00000100:00100000:2.0:1788925366.167803:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947735296 00000100:00100000:2.0:1788925366.167856:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788925366.167866:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947735296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925366.167913:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925366.167959:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947735296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925366.167977:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788925366.168162:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87534f800 x1875823947735296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925366.168181:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87534f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947735296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788925367.126814:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925368.150859:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788925368.369774:0:11711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788925369.174700:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925369.969465:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925369.969519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925369.969618:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921475968 00000100:00100000:2.0:1788925369.969629:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921475968 00000100:00100000:2.0:1788925369.969782:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 109 00000100:00100000:2.0:1788925369.969804:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921475968:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788925369.969884:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921475968:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 92us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925369.969892:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 109 00000100:00080000:3.0:1788925369.969958:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925369.970434:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921475840 00000100:00100000:1.0:1788925369.970440:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921475840 00000100:00100000:1.0:1788925369.970485:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 242 00000100:00100000:1.0:1788925369.970493:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921475840:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925369.970545:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9daa795-437c-4e56-9ebb-89af76979400+10:2361:x1875823921475840:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 53us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925369.970553:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 242 00010000:00010000:2.0:1788925370.199747:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925370.776342:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823947735680:0@lo:400:kworker.0 00000100:00100000:2.0:1788925370.776469:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925370.776553:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947736192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925370.776585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925370.776623:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788925370.776631:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947735552:0@lo:400:kworker.0 00000100:00100000:2.0:1788925370.776660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925370.776684:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947736064:0@lo:400:kworker.0 00000100:00100000:2.0:1788925370.776715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925370.776716:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947735424:0@lo:400:kworker.0 00000100:00100000:2.0:1788925370.776754:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947735808:0@lo:400:kworker.0 00000100:00100000:2.0:1788925370.776797:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925370.776808:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925370.776853:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947735680 00000100:00100000:2.0:1788925370.776865:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947735680 00000100:00100000:2.0:1788925370.776952:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947735552 00000100:00100000:2.0:1788925370.776967:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947735552 00000100:00100000:2.0:1788925370.777006:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788925370.777021:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823947735680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925370.777099:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823947735680:12345-0@lo:400:kworker.0 Request processed in 84us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925370.777107:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788925370.777111:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947735936:0@lo:400:kworker.0 00000100:00100000:2.0:1788925370.777136:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788925370.777146:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947735552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925370.777166:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925370.777203:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947735552:12345-0@lo:400:kworker.0 Request processed in 56us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925370.777210:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788925370.777232:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947735936 00000100:00100000:2.0:1788925370.777237:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947735936 00000100:00100000:0.0:1788925370.777264:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947735424 00000100:00100000:2.0:1788925370.777272:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788925370.777279:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947735424 00000100:00100000:2.0:1788925370.777286:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947735936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925370.777343:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947735936:12345-0@lo:400:kworker.0 Request processed in 61us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925370.777352:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788925370.777358:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788925370.777372:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3308:x1875823947735424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925370.777383:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947736192 00000100:00100000:2.0:1788925370.777390:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947736192 00000100:00100000:2.0:1788925370.777462:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788925370.777467:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3308:x1875823947735424:12345-0@lo:400:kworker.0 Request processed in 95us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925370.777476:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87534dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947736192:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925370.777485:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00002000:00000024:2.0:1788925370.777526:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925370.777589:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3308:1875823947735424:0@lo:400:kworker.0 00000100:00100000:2.0:1788925370.779730:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87534dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947736192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2245us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925370.779740:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947735936:0@lo:400:kworker.0 00000100:00100000:2.0:1788925370.779750:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788925370.779828:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947736064 00000100:00100000:2.0:1788925370.779849:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947736064 00000100:00100000:2.0:1788925370.781129:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947735808 00000100:00100000:2.0:1788925370.781139:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947735808 00000100:00080000:3.0:1788925370.781842:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925370.781851:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788925370.781856:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925370.784657:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788925370.784689:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947736064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925370.784827:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947736064:12345-0@lo:400:kworker.0 Request processed in 154us (8113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925370.784835:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788925370.784869:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788925370.784878:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947735808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925370.784956:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947735808:12345-0@lo:400:kworker.0 Request processed in 80us (8161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925370.784979:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788925370.785038:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87fc44700 x1875823947735808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925370.785056:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947735808:0@lo:400:kworker.0 00000100:00100000:0.0:1788925370.786511:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947735552:0@lo:400:kworker.0 00010000:00080000:0.0:1788925370.786534:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87fc45880 x1875823947736064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925370.786545:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947736064:0@lo:400:kworker.0 00000100:00100000:0.0:1788925370.786557:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823947735680:0@lo:400:kworker.0 00010000:00080000:0.0:1788925370.786569:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87fc45180 x1875823947736192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925370.786587:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947736192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788925371.222693:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925371.288593:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925371.288620:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947736320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925371.288697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925371.288820:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947736320 00000100:00100000:2.0:1788925371.288829:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947736320 00000100:00100000:2.0:1788925371.288888:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788925371.288900:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947736320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925371.288944:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925371.289003:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947736320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925371.289011:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788925371.289535:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8777d6a00 x1875823947736320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925371.289555:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947736320:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788925372.247501:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925373.271009:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788925373.763278:0:11810:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 23:42:51 (1788925371) === 00000100:00100000:0.0:1788925373.861121:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925373.861200:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921476096 00000100:00100000:2.0:1788925373.861210:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921476096 00000100:00100000:2.0:1788925373.861280:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00080000:3.0:1788925373.861287:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925373.861290:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:7629:x1875823921476096:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1788925373.861311:0:8592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925373.861389:0:8592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444400/0x503aa1a44b68e5d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1eec expref: -99 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.861716:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e5d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.861730:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.861741:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.861766:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e5e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.861775:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.861782:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862071:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862079:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e5d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862086:0:8592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e5d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862091:0:8592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e444600 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925373.862096:0:8592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e5d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862103:0:8592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e5d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862115:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:2.0:1788925373.862118:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925373.862122:0:8592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e5d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862128:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e5d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862147:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862153:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e5e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862159:0:8592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862164:0:8592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e445200 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925373.862168:0:8592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862174:0:8592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e5e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862182:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff98c85078e300) 00010000:00010000:2.0:1788925373.862184:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925373.862187:0:8592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e5e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862193:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e5e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862228:0:8592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444400/0x503aa1a44b68e5d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1eec expref: 7 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862238:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:2.0:1788925373.862241:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788925373.862251:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444400/0x503aa1a44b68e5d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1eec expref: 7 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925373.862261:0:8592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e444400, rc 0) 00000100:00100000:2.0:1788925373.862328:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:7629:x1875823921476096:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1038us (1218us total) trans 0 rc 301/301 00000100:00100000:2.0:1788925373.862336:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:2.0:1788925373.872331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925373.872433:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921476224 00000100:00100000:3.0:1788925373.872443:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921476224 00000100:00100000:3.0:1788925373.872496:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:3.0:1788925373.872506:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:7629:x1875823921476224:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788925373.872525:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925373.872549:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e5e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1ef3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.872625:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e5ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.872639:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e5ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.872666:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e5ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.872741:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e5f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.872749:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.872757:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873026:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e5ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873034:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e5ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873041:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e5ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873047:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8821c7000 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925373.873052:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e5ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873061:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e5ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873073:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:3.0:1788925373.873077:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925373.873081:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e5ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873093:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e5ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873105:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873111:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e5f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873117:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873123:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8821c6600 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925373.873126:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873132:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e5f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873139:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff98c862aca300) 00010000:00010000:3.0:1788925373.873142:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925373.873144:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e5f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873149:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e5f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873181:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e5e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ef3 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873216:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:3.0:1788925373.873219:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788925373.873223:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e5e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ef3 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925373.873233:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8821c7600, rc 0) 00000100:00100000:3.0:1788925373.873298:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:7629:x1875823921476224:12345-192.168.204.28@tcp:101:bash.0 Request processed in 792us (977us total) trans 0 rc 301/301 00000100:00100000:3.0:1788925373.873306:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:1.0:1788925373.880765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925373.881088:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921476352 00000100:00100000:3.0:1788925373.881099:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921476352 00000100:00100000:3.0:1788925373.881164:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:3.0:1788925373.881174:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:7629:x1875823921476352:12345-192.168.204.28@tcp:37:bash.0 00000100:00100000:2.0:1788925373.885888:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:7629:x1875823921476352:12345-192.168.204.28@tcp:37:bash.0 Request processed in 4586us (5004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925373.885906:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:3.0:1788925373.924024:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925373.924126:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921476480 00000100:00100000:1.0:1788925373.924137:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921476480 00000100:00100000:1.0:1788925373.924195:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1788925373.924205:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:10432:x1875823921476480:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:1.0:1788925373.924225:0:8592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925373.924247:0:8592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e5fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1efa expref: -99 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.924315:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e603 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.924330:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e603 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.924341:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e603 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.924438:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867e00/0x503aa1a44b68e60a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.924448:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867e00/0x503aa1a44b68e60a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.924456:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867e00/0x503aa1a44b68e60a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925726:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e603 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925738:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e603 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925745:0:8592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e603 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925752:0:8592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861866c00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:1.0:1788925373.925757:0:8592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e603 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925764:0:8592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e603 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925778:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:1.0:1788925373.925781:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925373.925785:0:8592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e603 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925791:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e603 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925810:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867e00/0x503aa1a44b68e60a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925817:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867e00/0x503aa1a44b68e60a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925822:0:8592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867e00/0x503aa1a44b68e60a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925827:0:8592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861867e00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:1.0:1788925373.925830:0:8592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867e00/0x503aa1a44b68e60a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925835:0:8592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867e00/0x503aa1a44b68e60a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925843:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff98c8709b8700) 00010000:00010000:1.0:1788925373.925845:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925373.925848:0:8592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867e00/0x503aa1a44b68e60a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925854:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867e00/0x503aa1a44b68e60a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925908:0:8592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e5fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1efa expref: 7 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925918:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:1.0:1788925373.925921:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925373.925929:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e5fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1efa expref: 7 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925373.925939:0:8592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c861866e00, rc 0) 00000100:00100000:1.0:1788925373.926011:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:10432:x1875823921476480:12345-192.168.204.28@tcp:101:rm.0 Request processed in 1807us (1997us total) trans 0 rc 301/301 00000100:00100000:1.0:1788925373.926020:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1788925374.008535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925374.008603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925374.008705:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921476608 00000100:00100000:3.0:1788925374.008723:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921476608 00000100:00100000:0.0:1788925374.008760:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921476736 00000100:00100000:0.0:1788925374.008771:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921476736 00000100:00100000:3.0:1788925374.008813:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:3.0:1788925374.008827:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+7:2358:x1875823921476608:12345-192.168.204.28@tcp:41:mkdir.0 00000004:00000024:3.0:1788925374.008905:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788925374.008916:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:3.0:1788925374.009040:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+7:2358:x1875823921476608:12345-192.168.204.28@tcp:41:mkdir.0 Request processed in 214us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925374.009051:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:0.0:1788925374.009315:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:10435:x1875823921476736:12345-192.168.204.28@tcp:700:mkdir.0 00000100:00100000:0.0:1788925374.009431:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:10435:x1875823921476736:12345-192.168.204.28@tcp:700:mkdir.0 Request processed in 122us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925374.014585:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.014893:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921476992 00000100:00100000:2.0:1788925374.014907:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921476992 00000100:00100000:2.0:1788925374.015061:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:2.0:1788925374.015073:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+7:10435:x1875823921476992:12345-192.168.204.28@tcp:36:mkdir.0 00010000:00010000:2.0:1788925374.015150:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925374.015357:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e4e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1ec9 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.015387:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:2.0:1788925374.015472:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788925374.016355:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e611 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.016373:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e611 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.016386:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e611 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925374.023104:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00010000:00010000:2.0:1788925374.023535:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e618 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.023553:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e618 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.023564:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e618 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925374.025677:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788925374.025697:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e611 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.025706:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e611 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.025714:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e611 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.025720:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e444600 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.025725:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e611 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.025733:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e611 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.025750:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078e300) 00010000:00010000:2.0:1788925374.025754:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925374.025758:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e611 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.025775:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e611 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788925374.025797:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f2d0eed reply state 000000006c1a18a5 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e618 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925374.025807:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788925374.025928:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+7:10435:x1875823921476992:12345-192.168.204.28@tcp:36:mkdir.0 Request processed in 10852us (11352us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788925374.025937:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00010000:00010000:0.0:1788925374.030310:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e618 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.030333:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e618 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.030342:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e618 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.030348:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e445200 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:0.0:1788925374.030354:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e618 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.030362:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e618 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.030384:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98c85078eb00) 00010000:00010000:0.0:1788925374.030388:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925374.030393:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e618 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.030426:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e618 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925374.042461:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.042772:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921477120 00000100:00100000:2.0:1788925374.042784:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921477120 00000100:00100000:2.0:1788925374.042846:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:2.0:1788925374.042857:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:10436:x1875823921477120:12345-192.168.204.28@tcp:101:chmod.0 00010000:00010000:2.0:1788925374.042899:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925374.042927:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e61f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.043001:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e626 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.043015:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.043026:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925374.043088:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788925374.043092:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788925374.043151:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.043181:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e61f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f01 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.043199:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f01 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.043208:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078e300) 00010000:00010000:2.0:1788925374.043211:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788925374.043214:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e444800, rc 0) 00000100:00100000:2.0:1788925374.043284:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+7:10436:x1875823921477120:12345-192.168.204.28@tcp:101:chmod.0 Request processed in 427us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925374.043293:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:3.0:1788925374.045894:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925374.046600:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921477376 00000100:00100000:1.0:1788925374.046610:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921477376 00000100:00100000:1.0:1788925374.046723:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:1.0:1788925374.046733:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+7:10436:x1875823921477376:12345-192.168.204.28@tcp:36:chmod.0 00010000:00010000:1.0:1788925374.046784:0:8592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925374.046810:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e626 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f01 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925374.046831:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078e300) 00010000:00010000:1.0:1788925374.046842:0:8592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788925374.046878:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e62d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925374.046891:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e62d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925374.046901:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e62d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788925374.047267:0:8592:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6c02b62 reply state 00000000dd1c85cb transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e62d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925374.047282:0:8592:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788925374.047295:0:8592:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788925374.047877:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+8:10436:x1875823921477376:12345-192.168.204.28@tcp:36:chmod.0 Request processed in 1131us (1996us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788925374.047887:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00010000:00010000:3.0:1788925374.053283:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e62d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.053303:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e62d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.053310:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e62d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.053315:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861866e00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925374.053321:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e62d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.053328:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e62d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.053349:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c8709b8700) 00010000:00010000:3.0:1788925374.053353:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788925374.053358:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e62d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.053363:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e62d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925374.102433:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.102640:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921477504 00000100:00100000:2.0:1788925374.102653:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921477504 00000100:00100000:2.0:1788925374.102715:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:2.0:1788925374.102725:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+7:10437:x1875823921477504:12345-192.168.204.28@tcp:101:chown.0 00010000:00010000:2.0:1788925374.102748:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925374.102772:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f08 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.102846:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444400/0x503aa1a44b68e63b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.102860:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444400/0x503aa1a44b68e63b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.102883:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444400/0x503aa1a44b68e63b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925374.102966:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788925374.102970:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788925374.103014:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444400/0x503aa1a44b68e63b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.103041:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f08 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.103061:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444400/0x503aa1a44b68e63b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f08 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.103071:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:2.0:1788925374.103073:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788925374.103077:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e444400, rc 0) 00000100:00100000:2.0:1788925374.103135:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:10437:x1875823921477504:12345-192.168.204.28@tcp:101:chown.0 Request processed in 411us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925374.103143:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:0.0:1788925374.109386:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.109612:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921477632 00000100:00100000:2.0:1788925374.109622:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921477632 00000100:00100000:2.0:1788925374.109683:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1788925374.109695:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:10437:x1875823921477632:12345-192.168.204.28@tcp:101:chown.0 00010000:00010000:2.0:1788925374.109717:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925374.109738:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.109806:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e649 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.109841:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.109853:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.109880:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e650 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.109888:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.109895:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110017:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110025:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110033:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925374.110073:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788925374.110077:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788925374.110099:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110112:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110130:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e649 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110137:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e649 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110143:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e445600 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.110154:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e649 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110162:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e649 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110175:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:2.0:1788925374.110178:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925374.110182:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110199:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110214:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110220:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e650 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110226:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110231:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e444c00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.110240:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110247:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e650 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110255:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98c85078e000) 00010000:00010000:2.0:1788925374.110257:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925374.110260:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e650 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110266:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e650 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110301:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f0f expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110315:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f0f expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.110322:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c85078ee00) 00010000:00010000:2.0:1788925374.110324:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788925374.110327:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e444000, rc 0) 00000100:00100000:2.0:1788925374.110547:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+9:10437:x1875823921477632:12345-192.168.204.28@tcp:101:chown.0 Request processed in 853us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925374.110555:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:3.0:1788925374.127053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.129347:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921477888 00000100:00100000:2.0:1788925374.129363:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921477888 00000100:00100000:2.0:1788925374.129466:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1788925374.129477:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8479ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+9:10437:x1875823921477888:12345-192.168.204.28@tcp:36:chown.0 00010000:00010000:2.0:1788925374.129553:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925374.129584:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e657 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f0f expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.129605:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c85078ee00) 00010000:00010000:2.0:1788925374.129618:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788925374.129646:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e65e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.129659:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e65e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.129670:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e65e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788925374.191857:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1788925374.191889:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788925374.192774:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdc337ac reply state 000000001dd81571 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e65e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925374.192791:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788925374.193017:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1788925374.193131:0:5849:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788925374.193289:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8479ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+7:10437:x1875823921477888:12345-192.168.204.28@tcp:36:chown.0 Request processed in 63806us (66239us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788925374.193308:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00010000:00010000:2.0:1788925374.197593:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e65e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.197619:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e65e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.197627:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e65e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.197634:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e444600 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.197649:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e65e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.197657:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e65e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.197696:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c85078e000) 00010000:00010000:2.0:1788925374.197699:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788925374.197704:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e65e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.197711:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e65e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925374.251124:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925374.251339:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921478016 00000100:00100000:1.0:1788925374.251350:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921478016 00000100:00100000:1.0:1788925374.251449:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:1.0:1788925374.251460:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:10438:x1875823921478016:12345-192.168.204.28@tcp:101:touch.500 00010000:00010000:1.0:1788925374.251497:0:8592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925374.251519:0:8592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e665 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f16 expref: -99 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788925374.264986:0:8592:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 13411us 00010000:00010000:3.0:1788925374.281988:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e66c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282015:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e66c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282035:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e66c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282052:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e673 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282060:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282066:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282505:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e67a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282516:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e67a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282524:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e67a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925374.282603:0:8592:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788925374.282608:0:8592:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788925374.282710:0:8592:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e67a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282725:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e66c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282733:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e66c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282750:0:8592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e66c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282756:0:8592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8821c7600 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925374.282761:0:8592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e66c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282771:0:8592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e66c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282783:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:3.0:1788925374.282786:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925374.282790:0:8592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e66c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282796:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e66c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282811:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282819:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e673 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282825:0:8592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282830:0:8592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8821c6600 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925374.282832:0:8592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282849:0:8592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e673 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282872:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98c862aca900) 00010000:00010000:3.0:1788925374.282875:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925374.282879:0:8592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e673 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282886:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e673 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282935:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e665 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f16 expref: 8 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282955:0:8592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e67a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f16 expref: 7 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.282963:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c862aca300) 00010000:00010000:3.0:1788925374.282965:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788925374.282969:0:8592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8821c7000, rc 0) 00000100:00100000:3.0:1788925374.283046:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+7:10438:x1875823921478016:12345-192.168.204.28@tcp:101:touch.500 Request processed in 31587us (31931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925374.283056:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:0.0:1788925374.287651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.287755:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921478272 00000100:00100000:2.0:1788925374.287765:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921478272 00000100:00100000:2.0:1788925374.287819:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:2.0:1788925374.287830:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+7:10438:x1875823921478272:12345-192.168.204.28@tcp:101:touch.500 00010000:00010000:2.0:1788925374.287849:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925374.288465:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e681 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.289152:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e688 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.289169:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e688 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.289183:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e688 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.289322:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e68f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.289332:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e68f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.289353:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e68f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788925374.292034:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788925374.292880:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e696 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.292900:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.292913:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.292956:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e688 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.292965:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e688 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.292973:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e688 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.292980:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e444000 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.292985:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e688 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.292993:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e688 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.293008:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c862aca300) 00010000:00010000:2.0:1788925374.293012:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925374.293025:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e688 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.293032:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e688 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788925374.293046:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008add6c08 reply state 000000007335711d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e68f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925374.293055:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788925374.293092:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e681 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f1d expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.293106:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f1d expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.293114:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c85078ee00) 00010000:00010000:2.0:1788925374.293117:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788925374.293119:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e445600, rc 0) 00000100:00100000:2.0:1788925374.293208:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+10:10438:x1875823921478272:12345-192.168.204.28@tcp:101:touch.500 Request processed in 5378us (5567us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788925374.293217:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00010000:00010000:0.0:1788925374.296324:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e68f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.296344:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e68f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.296353:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e68f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.296361:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e444c00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:0.0:1788925374.296366:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e68f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.296373:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e68f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.296389:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff98c85078e000) 00010000:00010000:0.0:1788925374.296392:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925374.296429:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e68f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.296437:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e68f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925374.300199:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.300350:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921478528 00000100:00100000:2.0:1788925374.300362:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921478528 00000100:00100000:2.0:1788925374.300443:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:2.0:1788925374.300455:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+9:10438:x1875823921478528:12345-192.168.204.28@tcp:36:touch.500 00010000:00010000:2.0:1788925374.300533:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925374.300573:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e696 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f1d expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.300624:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c85078ee00) 00010000:00010000:2.0:1788925374.300636:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788925374.300681:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.300695:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.300704:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.300712:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1788925374.300848:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce6eb705 reply state 00000000196a510d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925374.300857:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788925374.300968:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+10:10438:x1875823921478528:12345-192.168.204.28@tcp:36:touch.500 Request processed in 515us (785us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788925374.300975:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00010000:00010000:2.0:1788925374.310001:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.310021:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.310029:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.310035:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e444800 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.310040:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.310063:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.310081:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c85078ea00) 00010000:00010000:2.0:1788925374.310084:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925374.310089:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.310094:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925374.313624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.313705:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921478656 00000100:00100000:2.0:1788925374.313716:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921478656 00000100:00100000:2.0:1788925374.313778:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:2.0:1788925374.313789:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+9:10438:x1875823921478656:12345-192.168.204.28@tcp:101:touch.500 00010000:00010000:2.0:1788925374.313943:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925374.313972:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e6ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f24 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.314036:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e6ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f24 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.314050:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e6ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f24 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.314068:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c85078ee00) 00010000:00010000:2.0:1788925374.314071:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788925374.314075:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e445600, rc 0) 00000100:00100000:2.0:1788925374.314148:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+10:10438:x1875823921478656:12345-192.168.204.28@tcp:101:touch.500 Request processed in 361us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925374.314155:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:3.0:1788925374.325168:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925374.325323:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921478784 00000100:00100000:1.0:1788925374.325335:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921478784 00000100:00100000:1.0:1788925374.325386:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1788925374.325394:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875823921478784:12345-192.168.204.28@tcp:8:touch.500 00010000:00080000:1.0:1788925374.325471:0:6699:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp t0 exp 0000000000000000 cur 363 last 0 00000020:00000080:1.0:1788925374.325515:0:6699:0:(genops.c:1385:class_connect()) connect: client 5652db64-8dca-43c9-a8d1-41118f535cbb, cookie 0x503aa1a44b68e6b2 00002000:00100000:1.0:1788925374.325529:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5652db64-8dca-43c9-a8d1-41118f535cbb/ffff98c87767e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788925374.325555:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788925374.326028:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788925374.326064:0:6699:0:(import.c:65:import_set_state_nolock()) ffff98c87767a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925374.326334:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2357:x1875823921478784:12345-192.168.204.28@tcp:8:touch.500 Request processed in 937us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925374.326360:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1788925374.343741:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.349919:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921478912 00000100:00100000:2.0:1788925374.349936:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921478912 00000100:00100000:2.0:1788925374.350036:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:2.0:1788925374.350047:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:0:x1875823921478912:12345-192.168.204.28@tcp:2:touch.500 00000100:00080000:3.0:1788925374.351597:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788925374.405424:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5652db64-8dca-43c9-a8d1-41118f535cbb 00000001:00080000:2.0:1788925374.405707:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1788925374.405984:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:0:x1875823921478912:12345-192.168.204.28@tcp:2:touch.500 Request processed in 55931us (62246us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788925374.405997:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:3.0:1788925374.410138:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925374.410301:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921479168 00000100:00100000:1.0:1788925374.410311:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921479168 00000100:00100000:1.0:1788925374.410448:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:1.0:1788925374.410459:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+10:10438:x1875823921479168:12345-192.168.204.28@tcp:35:touch.500 00000100:00100000:1.0:1788925374.410855:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+11:10438:x1875823921479168:12345-192.168.204.28@tcp:35:touch.500 Request processed in 396us (726us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788925374.410882:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:0.0:1788925374.446051:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.446553:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921479296 00000100:00100000:2.0:1788925374.446564:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921479296 00000100:00100000:3.0:1788925374.446828:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:3.0:1788925374.446856:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+11:10439:x1875823921479296:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:3.0:1788925374.446893:0:8592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925374.446915:0:8592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e6b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f2b expref: -99 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.446983:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e6c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.446997:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.447009:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925374.447072:0:8592:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788925374.447077:0:8592:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788925374.447117:0:8592:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.447145:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e6b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f2b expref: 13 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.447162:0:8592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f2b expref: 12 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.447170:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c862aca300) 00010000:00010000:3.0:1788925374.447173:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788925374.447177:0:8592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8821c7600, rc 0) 00000100:00100000:3.0:1788925374.447341:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+12:10439:x1875823921479296:12345-192.168.204.28@tcp:101:rm.0 Request processed in 486us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925374.447360:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:3.0:1788925374.455503:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.455718:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921479552 00000100:00100000:2.0:1788925374.455732:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921479552 00000100:00100000:2.0:1788925374.455834:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:2.0:1788925374.455846:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+12:10439:x1875823921479552:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1788925374.455877:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925374.455900:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f32 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925374.456021:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788925374.456202:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f32 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.456219:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:2.0:1788925374.456224:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788925374.456231:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f32 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.456260:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e444800, rc 0) 00000100:00100000:2.0:1788925374.456337:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+13:10439:x1875823921479552:12345-192.168.204.28@tcp:101:rm.0 Request processed in 492us (848us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788925374.456346:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:0.0:1788925374.472116:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.472243:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921479680 00000100:00100000:2.0:1788925374.472254:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921479680 00000100:00100000:2.0:1788925374.472462:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:2.0:1788925374.472477:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+13:10439:x1875823921479680:12345-192.168.204.28@tcp:37:rm.0 00000100:00100000:0.0:1788925374.487306:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+13:10439:x1875823921479680:12345-192.168.204.28@tcp:37:rm.0 Request processed in 14820us (15189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925374.487328:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:3.0:1788925374.500837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925374.501094:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921479936 00000100:00100000:1.0:1788925374.501109:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921479936 00000100:00100000:1.0:1788925374.501203:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:1.0:1788925374.501216:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c858156c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+13:10439:x1875823921479936:12345-192.168.204.28@tcp:35:rm.0 00000100:00100000:1.0:1788925374.501640:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c858156c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+14:10439:x1875823921479936:12345-192.168.204.28@tcp:35:rm.0 Request processed in 425us (818us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788925374.501650:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:3.0:1788925374.505721:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.505965:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921480192 00000100:00100000:2.0:1788925374.505978:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921480192 00000100:00100000:2.0:1788925374.506052:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:2.0:1788925374.506064:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+14:10439:x1875823921480192:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1788925374.506095:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925374.506132:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e6d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f39 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.506289:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e6dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.506305:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e6dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.506318:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e6dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925374.506331:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788925374.506590:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e6d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f39 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.506619:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e6dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f39 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.506628:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c862aca300) 00010000:00010000:2.0:1788925374.506631:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788925374.506635:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e444000, rc 0) 00000100:00100000:2.0:1788925374.506734:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+16:10439:x1875823921480192:12345-192.168.204.28@tcp:101:rm.0 Request processed in 672us (1038us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788925374.506743:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:2.0:1788925374.518752:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925374.519436:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921480320 00000100:00100000:3.0:1788925374.519452:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921480320 00000100:00100000:3.0:1788925374.519523:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:3.0:1788925374.519535:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+16:10439:x1875823921480320:12345-192.168.204.28@tcp:41:rm.0 00000004:00000024:3.0:1788925374.519614:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788925374.520124:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+16:10439:x1875823921480320:12345-192.168.204.28@tcp:41:rm.0 Request processed in 588us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925374.520134:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:1.0:1788925374.535057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.535442:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921480448 00000100:00100000:2.0:1788925374.535457:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921480448 00000100:00100000:2.0:1788925374.535536:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:2.0:1788925374.535549:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+16:10439:x1875823921480448:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1788925374.535575:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925374.535615:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e6ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f40 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.535720:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e6f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.535739:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e6f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.535752:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e6f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.535796:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.535805:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.535811:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.535981:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e6ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.535990:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.535998:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925374.536031:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788925374.536037:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788925374.536059:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536072:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536081:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e6f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536089:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e6f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536108:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e6f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536115:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e445200 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.536120:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e6f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536129:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e6f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536144:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c862aca300) 00010000:00010000:2.0:1788925374.536147:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925374.536153:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e6f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536159:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e6f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536176:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536183:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536189:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536194:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e444800 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.536197:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536216:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536225:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff98c85078e900) 00010000:00010000:2.0:1788925374.536227:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925374.536230:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536237:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e6f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536273:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e6ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f40 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536288:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e6ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f40 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.536295:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c85078ee00) 00010000:00010000:2.0:1788925374.536297:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788925374.536300:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e444c00, rc 0) 00000100:00100000:2.0:1788925374.536389:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+17:10439:x1875823921480448:12345-192.168.204.28@tcp:101:rm.0 Request processed in 841us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925374.536397:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:0.0:1788925374.552905:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925374.553025:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921480704 00000100:00100000:3.0:1788925374.553038:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921480704 00000100:00100000:3.0:1788925374.553112:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:3.0:1788925374.553124:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+17:10439:x1875823921480704:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1788925374.553205:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788925374.553242:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e6ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f40 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.553278:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e6ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f24 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.553292:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c85078ee00) 00010000:00010000:3.0:1788925374.553313:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7600/0x503aa1a44b68e6c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f2b expref: 15 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.553353:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c862aca300) 00010000:00010000:3.0:1788925374.553357:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788925374.553388:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e706 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.553684:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e706 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.553697:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e706 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.554093:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6400/0x503aa1a44b68e70d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.554104:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6400/0x503aa1a44b68e70d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.554112:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6400/0x503aa1a44b68e70d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.554551:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fee00/0x503aa1a44b68e714 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.554561:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fee00/0x503aa1a44b68e714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.554569:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fee00/0x503aa1a44b68e714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788925374.569143:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788925374.569169:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363697767850ns, next at 364697761973ns, rc = 0 00010000:00010000:2.0:1788925374.569296:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e71b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569344:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e71b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569361:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e71b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569371:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e71b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569378:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e71b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569386:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e71b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569450:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925374.569483:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fee00/0x503aa1a44b68e714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569490:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fee00/0x503aa1a44b68e714 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569496:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fee00/0x503aa1a44b68e714 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569503:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8413fee00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.569508:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fee00/0x503aa1a44b68e714 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569517:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fee00/0x503aa1a44b68e714 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569544:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c862acab00) 00010000:00010000:2.0:1788925374.569547:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788925374.569554:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fee00/0x503aa1a44b68e714 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569561:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fee00/0x503aa1a44b68e714 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569585:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e706 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569592:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e706 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569599:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e706 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569604:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8821c6600 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.569607:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e706 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569613:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e706 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569621:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c862aca300) 00010000:00010000:2.0:1788925374.569624:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925374.569627:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e706 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.569645:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6600/0x503aa1a44b68e706 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788925374.569669:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f749bd18 reply state 00000000d6bfa0b5 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6400/0x503aa1a44b68e70d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925374.569679:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788925374.569795:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+16:10439:x1875823921480704:12345-192.168.204.28@tcp:36:rm.0 Request processed in 16667us (16899us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788925374.569806:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00010000:00010000:0.0:1788925374.570018:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925374.570027:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e71b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.570034:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e444600 already unused, calling callback (ffffffffc15c6230) 00010000:00010000:0.0:1788925374.570038:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e71b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.570045:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e71b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.570055:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c862acab00) 00010000:00010000:0.0:1788925374.570058:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788925374.570061:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e71b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.570066:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444600/0x503aa1a44b68e71b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925374.570085:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925374.570087:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925374.570089:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925374.592564:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1788925374.592679:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6400/0x503aa1a44b68e70d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.592720:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6400/0x503aa1a44b68e70d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.592729:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6400/0x503aa1a44b68e70d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.592736:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8821c6400 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925374.592743:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6400/0x503aa1a44b68e70d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.592752:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6400/0x503aa1a44b68e70d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.592774:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff98c862aca900) 00010000:00010000:3.0:1788925374.592779:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925374.592785:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6400/0x503aa1a44b68e70d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925374.592791:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c6400/0x503aa1a44b68e70d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925374.594045:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921480960 00000100:00100000:1.0:1788925374.594064:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921480960 00000100:00100000:1.0:1788925374.594145:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:1.0:1788925374.594158:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+15:10439:x1875823921480960:12345-192.168.204.28@tcp:35:rm.0 00000100:00100000:1.0:1788925374.595597:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+16:10439:x1875823921480960:12345-192.168.204.28@tcp:35:rm.0 Request processed in 1433us (3039us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788925374.595626:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:1.0:1788925374.601260:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925374.602540:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921481216 00000100:00100000:2.0:1788925374.602560:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921481216 00000100:00100000:2.0:1788925374.602637:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:2.0:1788925374.602650:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+16:10439:x1875823921481216:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1788925374.602749:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788925374.602788:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e6dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f39 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.602817:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8821c7000/0x503aa1a44b68e67a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f16 expref: 15 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.602832:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c862aca300) 00010000:00010000:2.0:1788925374.602850:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444400/0x503aa1a44b68e63b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f08 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.602868:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078ef00) 00010000:00010000:2.0:1788925374.602877:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788925374.602909:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e722 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.602945:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e722 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.602956:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e722 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.602971:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e729 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.602978:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e729 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.602984:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e729 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.603367:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e730 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.603375:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e730 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.603382:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e730 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925374.604136:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788925374.604159:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e730 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604167:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e730 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604175:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e730 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604189:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e445600 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.604194:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e730 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604202:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e730 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604215:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c85078e600) 00010000:00010000:2.0:1788925374.604218:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788925374.604222:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e730 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604228:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e730 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604252:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e722 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604258:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e722 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604265:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e722 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604270:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e444800 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.604272:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e722 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604278:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e722 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604295:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c85078e900) 00010000:00010000:2.0:1788925374.604298:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925374.604301:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e722 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.604306:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e722 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788925374.604320:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f52171f reply state 000000007347f715 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e729 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925374.604329:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788925374.604482:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+15:10439:x1875823921481216:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1830us (3243us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788925374.604491:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 30 00010000:00010000:2.0:1788925374.615968:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e729 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.615992:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e729 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.616002:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e729 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.616009:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e445200 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925374.616015:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e729 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.616026:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e729 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.616075:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98c85078ea00) 00010000:00010000:2.0:1788925374.616079:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925374.616085:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e729 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925374.616091:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445200/0x503aa1a44b68e729 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925375.088553:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925375.088605:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925375.088613:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921481472 00000100:00100000:3.0:1788925375.088628:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921481472 00000100:00100000:1.0:1788925375.088637:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925375.088665:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921481600 00000100:00100000:1.0:1788925375.088669:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921481600 00000100:00100000:3.0:1788925375.088708:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:1.0:1788925375.088716:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:3.0:1788925375.088728:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+14:2358:x1875823921481472:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925375.088728:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2358:x1875823921481600:12345-192.168.204.28@tcp:400:kworker.0 00000100:00080000:0.0:1788925375.089061:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925375.089079:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921481344 00000100:00100000:0.0:1788925375.089083:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921481344 00000100:00100000:0.0:1788925375.089115:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 244 00000100:00100000:0.0:1788925375.089139:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2358:x1875823921481344:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925375.089177:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2358:x1875823921481600:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 451us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925375.089187:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:3.0:1788925375.093463:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+14:2358:x1875823921481472:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 4388us (4575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925375.093484:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:0.0:1788925375.112131:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2358:x1875823921481344:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 22974us (23506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925375.112149:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 244 00010000:00010000:1.0:1788925375.318882:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788925375.895919:0:6847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365024514906ns, next at 366024509920ns, rc = 0 00000100:00100000:0.0:1788925375.896990:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c84a0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947736576:0@lo:400:kworker.0 00000100:00100000:1.0:1788925375.897284:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87fc44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947736448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925375.897598:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947736704:0@lo:400:kworker.0 00000100:00100000:2.0:1788925375.897784:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947736832:0@lo:400:kworker.0 00000100:00100000:1.0:1788925375.903034:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925375.903182:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947736960:0@lo:400:kworker.0 00000100:00100000:1.0:1788925375.904971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925375.905086:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947736960 00000100:00100000:1.0:1788925375.905098:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947736960 00000100:00100000:1.0:1788925375.905443:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788925375.905458:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947736960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925375.905546:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947736960:12345-0@lo:400:kworker.0 Request processed in 94us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925375.905554:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788925375.905609:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c86e757b80 x1875823947736960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925375.905645:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947736960:0@lo:400:kworker.0 00000100:00080000:1.0:1788925375.905984:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925375.906034:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947736448 00000100:00100000:1.0:1788925375.906041:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947736448 00000100:00100000:1.0:1788925375.906088:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788925375.906096:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947736448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788925375.906394:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925375.906479:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947736448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 383us (3456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925375.906486:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788925375.906519:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87fc44000 x1875823947736448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925375.906540:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87fc44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947736448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925375.909072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925375.909159:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87cefc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947737216:0@lo:400:kworker.0 00000100:00100000:3.0:1788925375.909210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925375.909281:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947737216 00000100:00100000:3.0:1788925375.909292:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947737216 00000100:00100000:3.0:1788925375.909360:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788925375.909371:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947737216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925375.909451:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947737216:12345-0@lo:400:kworker.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925375.909458:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788925375.909481:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788925375.909513:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87cefc000 x1875823947737216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925375.909530:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87cefc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947737216:0@lo:400:kworker.0 00000100:00100000:1.0:1788925375.914291:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947736704 00000100:00100000:1.0:1788925375.914313:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947736704 00000100:00100000:1.0:1788925375.914426:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788925375.914438:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ceff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947736704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925375.914568:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ceff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947736704:12345-0@lo:400:kworker.0 Request processed in 132us (5509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925375.914576:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788925375.915191:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947736704:0@lo:400:kworker.0 00000100:00100000:0.0:1788925375.919627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925375.919949:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947736576 00000100:00100000:1.0:1788925375.919965:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947736576 00000100:00100000:1.0:1788925375.920059:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788925375.920080:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947736576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925375.920198:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947736576:12345-0@lo:400:kworker.0 Request processed in 120us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925375.920225:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788925375.921433:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c84a0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947736576:0@lo:400:kworker.0 00000100:00100000:0.0:1788925375.921451:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947737088:0@lo:400:kworker.0 00000100:00100000:0.0:1788925375.921506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925375.921751:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947737088 00000100:00100000:1.0:1788925375.921758:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947737088 00000100:00100000:1.0:1788925375.921820:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788925375.921829:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947737088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925375.921892:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947737088:12345-0@lo:400:kworker.0 Request processed in 64us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925375.921899:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788925375.922098:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788925375.922470:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925375.922505:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947737088:0@lo:400:kworker.0 00000100:00100000:1.0:1788925375.922619:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947736832 00000100:00100000:1.0:1788925375.922625:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947736832 00000100:00100000:1.0:1788925375.922673:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788925375.922682:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947736832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925375.922747:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947736832:12345-0@lo:400:kworker.0 Request processed in 67us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925375.922753:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1788925375.923093:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925375.923433:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947736832:0@lo:400:kworker.0 00010000:00010000:0.0:1788925376.345872:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925376.406955:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947737344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925376.407073:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925376.407328:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947737344 00000100:00100000:2.0:1788925376.407350:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947737344 00000100:00100000:2.0:1788925376.407452:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788925376.407464:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c84a0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947737344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925376.407515:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925376.407574:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c84a0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947737344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925376.407583:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1788925376.407744:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8777d6a00 x1875823947737344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925376.407768:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947737344:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788925377.367076:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925378.395908:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925379.414801:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788925379.525315:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788925379.525353:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:1.0:1788925379.525369:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788925379.525386:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788925379.525660:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925379.525692:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87cefc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947737472:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788925379.525806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925379.525945:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947737472 00000100:00100000:3.0:1788925379.525956:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947737472 00000100:00100000:3.0:1788925379.526039:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925379.526051:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947737472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788925379.526087:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788925379.526220:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa0d5be, atime: 0x6aa0d5be, ctime: 0x6aa0d5be, blocks: 0x1 00010000:00010000:3.0:1788925379.526252:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088b5ddcb/0x503aa1a44b68e737 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925379.526274:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=368s v=(0 0) 00010000:00010000:3.0:1788925379.526280:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925379.526288:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b5ddcb/0x503aa1a44b68e737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925379.526311:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088b5ddcb/0x503aa1a44b68e737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925379.526324:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088b5ddcb/0x503aa1a44b68e737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925379.526333:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088b5ddcb/0x503aa1a44b68e737 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925379.526358:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1788925379.528309:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925379.529367:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875823947737472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3307us (3549us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788925379.529383:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788925379.529454:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925379.529465:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088b5ddcb/0x503aa1a44b68e737 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925379.529482:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8413fe400 already unused, calling callback (ffffffffc15c6230) 00010000:00010000:3.0:1788925379.529488:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b5ddcb/0x503aa1a44b68e737 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925379.529531:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b5ddcb/0x503aa1a44b68e737 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925379.529561:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088b5ddcb/0x503aa1a44b68e737 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925379.529569:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088b5ddcb/0x503aa1a44b68e737 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925379.529599:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925379.529602:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925379.529604:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788925379.537993:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c87cefc000/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788925379.538017:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87cefc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947737472:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788925380.208186:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925380.210526:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921481728 00000100:00100000:3.0:1788925380.210548:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921481728 00000100:00100000:3.0:1788925380.210717:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 246 00000100:00100000:3.0:1788925380.210730:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2358:x1875823921481728:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925380.210876:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2358:x1875823921481728:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 147us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925380.210885:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 246 00000100:00100000:1.0:1788925380.229487:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925380.229631:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925380.229817:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921481984 00000100:00100000:3.0:1788925380.229835:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921481984 00000100:00100000:3.0:1788925380.229952:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:3.0:1788925380.229967:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2358:x1875823921481984:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925380.230071:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2358:x1875823921481984:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 108us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925380.230113:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00080000:1.0:1788925380.230729:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925380.230827:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921481856 00000100:00100000:0.0:1788925380.230839:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921481856 00000100:00100000:0.0:1788925380.230954:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:0.0:1788925380.230965:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2358:x1875823921481856:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788925380.231057:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2358:x1875823921481856:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 94us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925380.231065:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00080000:1.0:1788925380.231977:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788925380.438723:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925381.015345:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947737728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925381.015461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925381.015894:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875823947737984:0@lo:400:kworker.0 00000100:00100000:1.0:1788925381.015952:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925381.015977:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925381.015983:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947737856:0@lo:400:kworker.0 00000100:00100000:1.0:1788925381.016029:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925381.016178:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c85f9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947737600:0@lo:400:kworker.0 00000100:00100000:3.0:1788925381.016225:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925381.016259:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947738240:0@lo:400:kworker.0 00000100:00100000:3.0:1788925381.016288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925381.016309:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925381.016314:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947738112:0@lo:400:kworker.0 00000100:00100000:3.0:1788925381.016338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925381.016370:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947737984 00000100:00100000:3.0:1788925381.016379:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947737984 00000100:00100000:3.0:1788925381.016463:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947737856 00000100:00100000:3.0:1788925381.016467:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947737856 00000100:00100000:3.0:1788925381.016482:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947738112 00000100:00100000:3.0:1788925381.016485:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947738112 00000100:00100000:3.0:1788925381.016502:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788925381.016512:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875823947737984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925381.016569:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875823947737984:12345-0@lo:400:kworker.0 Request processed in 58us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925381.016577:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788925381.016598:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788925381.016603:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947737856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925381.016631:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875823947737856:12345-0@lo:400:kworker.0 Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925381.016637:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788925381.016647:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788925381.016653:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947738112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925381.016694:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823947738112:12345-0@lo:400:kworker.0 Request processed in 41us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925381.016701:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788925381.016720:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947737600 00000100:00100000:3.0:1788925381.016724:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947737600 00000100:00100000:3.0:1788925381.016763:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788925381.016770:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947737600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925381.016800:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947737600:12345-0@lo:400:kworker.0 Request processed in 31us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925381.017005:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947737728 00000100:00100000:2.0:1788925381.017011:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947737728 00000100:00100000:2.0:1788925381.018439:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788925381.018477:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875823947737728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925381.018530:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925381.018624:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875823947737728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (3163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925381.018654:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788925381.018768:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788925381.018776:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925381.018799:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947738240 00000100:00100000:2.0:1788925381.018808:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947738240 00000100:00100000:2.0:1788925381.018863:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788925381.018871:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947738240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925381.018923:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947738240:12345-0@lo:400:kworker.0 Request processed in 54us (2634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925381.018929:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788925381.018949:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788925381.019003:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823947738112:0@lo:400:kworker.0 00000100:00100000:2.0:1788925381.019019:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947737600:0@lo:400:kworker.0 00010000:00080000:2.0:1788925381.019034:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c86e757800 x1875823947738240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925381.019046:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947738240:0@lo:400:kworker.0 00000100:00100000:1.0:1788925381.019831:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c85f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875823947737856:0@lo:400:kworker.0 00000100:00100000:1.0:1788925381.019851:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875823947737984:0@lo:400:kworker.0 00000100:00100000:0.0:1788925381.020014:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947737728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925381.020244:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00010000:00010000:3.0:1788925381.462891:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925381.529154:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8777d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947738368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925381.529243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925381.530577:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947738368 00000100:00100000:3.0:1788925381.530590:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947738368 00000100:00100000:3.0:1788925381.530669:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788925381.530681:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947738368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925381.530721:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925381.532138:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947738368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1453us (2888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925381.532150:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788925381.532275:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c8777d6a00 x1875823947738368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925381.532299:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8777d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947738368:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788925382.486683:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925382.755574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925382.755742:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921482112 00000100:00100000:3.0:1788925382.755753:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921482112 00000100:00100000:3.0:1788925382.755838:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:3.0:1788925382.755849:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:10952:x1875823921482112:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:3.0:1788925382.755878:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925382.755901:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e73e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f47 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925382.755988:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e745 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925382.756001:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925382.756015:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925382.756236:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788925382.756241:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788925382.756333:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925382.756359:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e73e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f47 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925382.756376:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e745 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f47 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925382.756385:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c862aca900) 00010000:00010000:3.0:1788925382.756388:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788925382.756391:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8413ff400, rc 0) 00000100:00100000:3.0:1788925382.756501:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:10952:x1875823921482112:12345-192.168.204.28@tcp:101:rm.0 Request processed in 654us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925382.756508:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00080000:2.0:1788925382.756577:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925382.762125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925382.762283:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921482240 00000100:00100000:0.0:1788925382.762293:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921482240 00000100:00100000:0.0:1788925382.762356:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:0.0:1788925382.762367:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8777d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:10952:x1875823921482240:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:0.0:1788925382.762385:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925382.762444:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e74c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f4e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.762513:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbea00/0x503aa1a44b68e753 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.762526:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbea00/0x503aa1a44b68e753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.762538:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbea00/0x503aa1a44b68e753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.762597:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e75a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.762617:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.762624:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763313:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbea00/0x503aa1a44b68e753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763324:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbea00/0x503aa1a44b68e753 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763331:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbea00/0x503aa1a44b68e753 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763337:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbea00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:0.0:1788925382.763342:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbea00/0x503aa1a44b68e753 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763350:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbea00/0x503aa1a44b68e753 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763363:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c862aca900) 00010000:00010000:0.0:1788925382.763366:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925382.763370:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbea00/0x503aa1a44b68e753 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763377:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbea00/0x503aa1a44b68e753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763390:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763521:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e75a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763527:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e75a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763533:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbfc00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:0.0:1788925382.763536:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e75a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763542:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e75a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763554:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff98c8618c5100) 00010000:00010000:0.0:1788925382.763557:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925382.763559:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e75a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763565:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e75a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763599:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e74c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f4e expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763608:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c862aca900) 00010000:00010000:0.0:1788925382.763610:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788925382.763613:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e74c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f4e expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925382.763621:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c846cbf400, rc 0) 00000100:00100000:0.0:1788925382.763691:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8777d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:10952:x1875823921482240:12345-192.168.204.28@tcp:101:rm.0 Request processed in 1325us (1576us total) trans 0 rc 301/301 00000100:00100000:0.0:1788925382.763699:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 32 00010000:00010000:3.0:1788925383.512926:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925384.546018:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788925384.712928:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:3.0:1788925385.334490:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925385.334562:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925385.334610:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925385.334652:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921482624 00000100:00100000:3.0:1788925385.334675:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921482624 00000100:00100000:3.0:1788925385.334761:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:3.0:1788925385.334773:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921482624:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925385.334873:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921482624:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 102us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925385.334883:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00080000:3.0:1788925385.334909:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925385.334930:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921482496 00000100:00100000:1.0:1788925385.334937:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921482496 00000100:00100000:1.0:1788925385.335002:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:1.0:1788925385.335013:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921482496:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925385.335050:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921482496:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 41us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925385.335057:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:0.0:1788925385.335080:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921482368 00000100:00100000:0.0:1788925385.335085:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921482368 00000100:00100000:0.0:1788925385.335127:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 248 00000100:00100000:0.0:1788925385.335135:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921482368:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788925385.335166:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921482368:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 33us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925385.335174:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 248 00000100:00080000:2.0:1788925385.335463:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788925385.560812:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925386.134946:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947738496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925386.135053:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925386.135582:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947739008:0@lo:400:kworker.0 00000100:00100000:3.0:1788925386.135625:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925386.135661:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925386.135668:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875823947738880:0@lo:400:kworker.0 00000100:00100000:3.0:1788925386.135693:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925386.135835:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947738752:0@lo:400:kworker.0 00000100:00100000:1.0:1788925386.135869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925386.135890:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788925386.135908:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947738624:0@lo:400:kworker.0 00000100:00100000:1.0:1788925386.135951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925386.135989:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87d1b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947739136:0@lo:400:kworker.0 00000100:00100000:1.0:1788925386.136018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925386.136054:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947739136 00000100:00100000:1.0:1788925386.136064:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947739136 00000100:00100000:1.0:1788925386.136139:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788925386.136151:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947739136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925386.136226:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823947739136:12345-0@lo:400:kworker.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925386.136233:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788925386.136273:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947738880 00000100:00100000:1.0:1788925386.136277:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947738880 00000100:00100000:1.0:1788925386.136306:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947738752 00000100:00100000:1.0:1788925386.136309:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947738752 00000100:00100000:1.0:1788925386.136326:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788925386.136332:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875823947738880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925386.136372:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875823947738880:12345-0@lo:400:kworker.0 Request processed in 40us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925386.136378:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788925386.136391:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788925386.136396:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947738752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925386.136463:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823947738752:12345-0@lo:400:kworker.0 Request processed in 66us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925386.136470:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:1.0:1788925386.136516:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87d1b9180 x1875823947739136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925386.136549:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947739136:0@lo:400:kworker.0 00000100:00100000:1.0:1788925386.136564:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823947738752:0@lo:400:kworker.0 00000100:00100000:1.0:1788925386.136605:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875823947738880:0@lo:400:kworker.0 00000100:00100000:1.0:1788925386.136669:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947738624 00000100:00100000:1.0:1788925386.136673:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947738624 00000100:00100000:1.0:1788925386.136704:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788925386.136710:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947738624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925386.137082:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3306:x1875823947738624:12345-0@lo:400:kworker.0 Request processed in 370us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925386.137090:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788925386.137137:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3306:1875823947738624:0@lo:400:kworker.0 00000100:00100000:3.0:1788925386.137383:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947739008 00000100:00100000:3.0:1788925386.137390:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947739008 00000100:00100000:3.0:1788925386.137457:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788925386.137470:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947739008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925386.137523:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875823947739008:12345-0@lo:400:kworker.0 Request processed in 60us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925386.137530:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788925386.137563:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87d1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875823947739008:0@lo:400:kworker.0 00000100:00100000:2.0:1788925386.137669:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947738496 00000100:00100000:2.0:1788925386.137675:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947738496 00000100:00100000:2.0:1788925386.137724:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788925386.137744:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947738496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925386.137788:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925386.137854:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947738496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (2801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925386.137861:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788925386.137884:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788925386.137890:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788925386.137893:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788925386.138367:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788925386.138376:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c87cefc000, transno 4294967300 00000100:00100000:3.0:1788925386.138435:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947738496:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788925386.586168:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925386.647812:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788925386.647847:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947739264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925386.647960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925386.648287:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947739264 00000100:00100000:2.0:1788925386.648300:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947739264 00000100:00100000:2.0:1788925386.648365:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788925386.648377:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947739264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925386.648471:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925386.648545:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947739264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925386.648555:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1788925386.650144:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87ccf0e00 x1875823947739264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925386.650189:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947739264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925387.606904:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925388.634842:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788925389.188296:0:11888:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 157d: llapi changelog scanner API tests === 23:43:06 (1788925386) 00010000:00010000:3.0:1788925389.655486:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925389.728739:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925389.729242:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921482752 00000100:00100000:3.0:1788925389.729255:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921482752 00000100:00100000:3.0:1788925389.729320:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:3.0:1788925389.729332:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:11329:x1875823921482752:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:3.0:1788925389.729353:0:8592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925389.729375:0:8592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e761 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f55 expref: -99 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729474:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e768 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729489:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e768 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729501:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e768 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729567:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e76f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729576:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e76f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729583:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e76f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788925389.729658:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788925389.729841:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e768 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729860:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e768 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729867:0:8592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e768 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729873:0:8592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8413fe400 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925389.729878:0:8592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e768 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729887:0:8592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e768 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729900:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c862aca900) 00010000:00010000:3.0:1788925389.729904:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925389.729909:0:8592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e768 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729915:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e768 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729930:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e76f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729935:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e76f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729940:0:8592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e76f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729945:0:8592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8413ffa00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925389.729954:0:8592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e76f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729961:0:8592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e76f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729969:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf03956b8 (ffff98c862aca100) 00010000:00010000:3.0:1788925389.729972:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925389.729975:0:8592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e76f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.729980:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e76f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.730015:0:8592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e761 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f55 expref: 7 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.730025:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c862aca900) 00010000:00010000:3.0:1788925389.730027:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925389.730030:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e761 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f55 expref: 7 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.730039:0:8592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8413fe000, rc 0) 00000100:00100000:3.0:1788925389.730111:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:11329:x1875823921482752:12345-192.168.204.28@tcp:101:rm.0 Request processed in 781us (1384us total) trans 0 rc 301/301 00000100:00100000:3.0:1788925389.731682:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:2.0:1788925389.780745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925389.788552:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921483008 00000100:00100000:3.0:1788925389.788568:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921483008 00000100:00100000:3.0:1788925389.789113:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:3.0:1788925389.789126:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:11330:x1875823921483008:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1788925389.789204:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925389.789240:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e745 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f47 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.789264:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c862aca900) 00010000:00010000:3.0:1788925389.789275:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788925389.790144:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e776 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.790164:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e776 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.790177:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e776 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.790192:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e77d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.790200:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e77d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925389.790207:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e77d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925389.794835:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788925389.794857:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e776 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925389.794868:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e776 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925389.794876:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e776 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925389.794882:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8413fe000 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925389.794886:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e776 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925389.794906:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e776 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925389.794927:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c862aca100) 00010000:00010000:2.0:1788925389.794930:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925389.794935:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e776 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925389.794941:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe000/0x503aa1a44b68e776 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788925389.794963:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000338ff21e reply state 00000000dec23716 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e77d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925389.794974:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788925389.795113:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+7:11330:x1875823921483008:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 5979us (14376us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788925389.795195:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00010000:00010000:0.0:1788925389.797756:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e77d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925389.797773:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e77d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925389.797781:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e77d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925389.797805:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8413ffa00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:0.0:1788925389.797811:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e77d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925389.797818:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e77d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925389.797835:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf03956b8 (ffff98c862aca700) 00010000:00010000:0.0:1788925389.797838:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925389.797842:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e77d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925389.797849:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e77d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925390.445213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925390.445261:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925390.445294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925390.445446:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921483264 00000100:00100000:0.0:1788925390.445460:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921483264 00000100:00100000:0.0:1788925390.445542:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:0.0:1788925390.445554:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921483264:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788925390.445679:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921483264:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 126us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925390.445689:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:1.0:1788925390.445784:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921483392 00000100:00100000:1.0:1788925390.445789:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921483392 00000100:00100000:1.0:1788925390.445846:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:1.0:1788925390.445855:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921483392:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925390.445890:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921483392:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 37us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925390.445896:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00080000:0.0:1788925390.446063:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925390.446228:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921483136 00000100:00100000:3.0:1788925390.446235:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921483136 00000100:00100000:3.0:1788925390.446277:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 250 00000100:00100000:3.0:1788925390.446285:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921483136:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925390.446333:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2360:x1875823921483136:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 48us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925390.446366:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 250 00010000:00010000:1.0:1788925390.689803:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925391.256090:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925391.256119:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947739392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925391.256213:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925391.256296:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947739392 00000100:00100000:2.0:1788925391.256306:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947739392 00000100:00100000:2.0:1788925391.256375:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788925391.256387:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947739392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925391.256466:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925391.256521:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875823947739392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925391.256529:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788925391.256571:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788925391.256617:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875823947739392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925391.256888:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947739648:0@lo:400:kworker.0 00000100:00100000:1.0:1788925391.256930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925391.256963:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788925391.256969:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947739776:0@lo:400:kworker.0 00000100:00100000:1.0:1788925391.256992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925391.257023:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947739648 00000100:00100000:1.0:1788925391.257029:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947739648 00000100:00100000:1.0:1788925391.257064:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947739776 00000100:00100000:1.0:1788925391.257067:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947739776 00000100:00100000:1.0:1788925391.257095:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788925391.257102:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947739648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925391.257143:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823947739648:12345-0@lo:400:kworker.0 Request processed in 41us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925391.257150:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788925391.257166:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788925391.257172:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947739776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925391.257203:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823947739776:12345-0@lo:400:kworker.0 Request processed in 31us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925391.257208:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788925391.257307:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823947739776:0@lo:400:kworker.0 00000100:00100000:1.0:1788925391.257316:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823947739648:0@lo:400:kworker.0 00000100:00100000:3.0:1788925391.257531:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947739904:0@lo:400:kworker.0 00000100:00100000:3.0:1788925391.257581:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925391.257609:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788925391.257616:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947739520:0@lo:400:kworker.0 00000100:00100000:3.0:1788925391.257648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925391.257673:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c875362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947740032:0@lo:400:kworker.0 00000100:00100000:3.0:1788925391.257699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925391.257782:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947739904 00000100:00100000:2.0:1788925391.257788:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947739904 00000100:00100000:2.0:1788925391.257832:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788925391.257841:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947739904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925391.257885:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823947739904:12345-0@lo:400:kworker.0 Request processed in 46us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925391.257891:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788925391.257915:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925391.257938:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823947739904:0@lo:400:kworker.0 00000100:00100000:1.0:1788925391.258047:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947739520 00000100:00100000:1.0:1788925391.258052:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947739520 00000100:00100000:1.0:1788925391.258693:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788925391.258706:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3307:x1875823947739520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925391.258774:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3307:x1875823947739520:12345-0@lo:400:kworker.0 Request processed in 72us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925391.258781:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788925391.258862:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3307:1875823947739520:0@lo:400:kworker.0 00000100:00100000:1.0:1788925391.261895:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947740032 00000100:00100000:1.0:1788925391.261912:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947740032 00000100:00100000:1.0:1788925391.262002:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788925391.262015:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947740032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925391.262148:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947740032:12345-0@lo:400:kworker.0 Request processed in 136us (4447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925391.262157:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788925391.262216:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c875362d80 x1875823947740032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925391.262236:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c875362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947740032:0@lo:400:kworker.0 00000100:00080000:3.0:1788925391.262356:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788925391.703243:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925391.770350:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c87ccf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947740160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925391.770490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925391.770636:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947740160 00000100:00100000:3.0:1788925391.770647:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947740160 00000100:00100000:3.0:1788925391.770715:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788925391.770727:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947740160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925391.770775:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925391.774275:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947740160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3533us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925391.774294:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1788925391.775727:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c87ccf3100 x1875823947740160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925391.775764:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c87ccf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947740160:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788925392.553881:0:11987:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00010000:00010000:0.0:1788925392.733189:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925393.750829:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788925394.036097:0:12035:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007fff501b41c0 00000004:00000080:2.0:1788925394.036125:0:12035:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff98c875366800 uarg=0000000000000000 00000004:00000080:2.0:1788925394.036184:0:12035:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff98c875366800 00000040:00080000:2.0:1788925394.036627:0:12035:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788925394.036874:0:12035:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788925394.036959:0:12035:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 80 off8272 00000004:00000080:2.0:1788925394.037011:0:12035:0:(mdd_device.c:1855:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl1', mask 0x0 00000004:02000000:2.0:1788925394.037015:0:12035:0:(mdd_device.c:471:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:2.0:1788925394.202812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925394.203162:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921483520 00000100:00100000:3.0:1788925394.203177:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921483520 00000100:00100000:3.0:1788925394.203313:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:3.0:1788925394.203327:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:11371:x1875823921483520:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788925394.203358:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925394.203396:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f5c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.203564:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e78b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.203591:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e78b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.203610:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e78b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925394.203698:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788925394.203702:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788925394.203760:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e78b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.203795:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f5c expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.203819:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e78b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f5c expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.203975:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c862aca300) 00010000:00010000:3.0:1788925394.203980:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788925394.203985:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8413fe400, rc 0) 00000100:00100000:3.0:1788925394.204131:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+7:11371:x1875823921483520:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 805us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925394.204141:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00080000:2.0:1788925394.204270:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925394.209266:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925394.209394:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921483776 00000100:00100000:3.0:1788925394.209481:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921483776 00000100:00100000:3.0:1788925394.209586:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:3.0:1788925394.209599:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+7:11371:x1875823921483776:12345-192.168.204.28@tcp:36:llapi_scan_chan.0 00010000:00010000:3.0:1788925394.209669:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925394.209711:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e78b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f5c expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.209730:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c862aca300) 00010000:00010000:3.0:1788925394.209743:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925394.209984:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:11371:x1875823921483776:12345-192.168.204.28@tcp:36:llapi_scan_chan.0 Request processed in 385us (731us total) trans 0 rc -17/-17 00000100:00100000:3.0:1788925394.209992:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:1.0:1788925394.213180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925394.213587:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921483904 00000100:00100000:3.0:1788925394.213601:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921483904 00000100:00100000:3.0:1788925394.213684:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:3.0:1788925394.213697:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:11371:x1875823921483904:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788925394.213725:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925394.213756:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.213849:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff200/0x503aa1a44b68e799 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.213865:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff200/0x503aa1a44b68e799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.213877:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff200/0x503aa1a44b68e799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925394.213966:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788925394.213971:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788925394.214006:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff200/0x503aa1a44b68e799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.214050:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f63 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.216638:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff200/0x503aa1a44b68e799 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f63 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.216655:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c862acae00) 00010000:00010000:3.0:1788925394.216658:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788925394.216663:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8413ff200, rc 0) 00000100:00100000:3.0:1788925394.216773:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+7:11371:x1875823921483904:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 3076us (3605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925394.216783:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:2.0:1788925394.225168:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925394.226206:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921484032 00000100:00100000:1.0:1788925394.226224:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921484032 00000100:00100000:1.0:1788925394.226480:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:1.0:1788925394.226494:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+7:11371:x1875823921484032:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:1.0:1788925394.226533:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925394.226561:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e7a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.226648:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e7a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.226757:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.226771:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.226790:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e7ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.226797:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e7ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.226804:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e7ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231574:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867400/0x503aa1a44b68e7b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231602:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867400/0x503aa1a44b68e7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231617:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867400/0x503aa1a44b68e7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788925394.231685:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1788925394.231691:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788925394.231729:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867400/0x503aa1a44b68e7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231748:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231779:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e7a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231785:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231791:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861867200 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:1.0:1788925394.231796:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231805:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e7a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231821:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c862acae00) 00010000:00010000:1.0:1788925394.231824:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925394.231830:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e7a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231836:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e7a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231857:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e7ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231863:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e7ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231869:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e7ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231874:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861866000 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:1.0:1788925394.231883:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e7ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231889:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e7ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231896:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf03956b8 (ffff98c8709b8e00) 00010000:00010000:1.0:1788925394.231898:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925394.231902:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e7ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231907:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e7ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231969:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e7a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f6a expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.231985:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867400/0x503aa1a44b68e7b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f6a expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925394.232007:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c8709b8000) 00010000:00010000:1.0:1788925394.232009:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788925394.232012:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c861867400, rc 0) 00000100:00100000:1.0:1788925394.232134:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:11371:x1875823921484032:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 5641us (6981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925394.232144:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:0.0:1788925394.249934:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925394.250082:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921484288 00000100:00100000:1.0:1788925394.250098:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921484288 00000100:00100000:1.0:1788925394.250185:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:1.0:1788925394.250198:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+8:11371:x1875823921484288:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:1.0:1788925394.250236:0:8592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925394.250267:0:8592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e7bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f71 expref: -99 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.267219:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e7c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.267253:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e7c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.267267:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e7c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.267289:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.267296:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.267303:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788925394.268517:0:8592:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00000040:00080000:0.0:1788925394.268687:0:8592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788925394.268886:0:8592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 64 off8256 00010000:00010000:0.0:1788925394.273174:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe400/0x503aa1a44b68e7d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.273211:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe400/0x503aa1a44b68e7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.273229:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe400/0x503aa1a44b68e7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.273313:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e7c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.273696:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e7c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.273707:0:8592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e7c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.273714:0:8592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbf400 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:0.0:1788925394.273720:0:8592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e7c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.273730:0:8592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e7c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.273748:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c8709b8000) 00010000:00010000:0.0:1788925394.273751:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925394.273759:0:8592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e7c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.273765:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf400/0x503aa1a44b68e7c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788925394.273780:0:8592:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d07b3128 reply state 00000000977a779d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925394.273792:0:8592:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788925394.273854:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e7bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f71 expref: 11 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.273876:0:8592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe400/0x503aa1a44b68e7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f71 expref: 10 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925394.273898:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff98c8618c5000) 00010000:00010000:0.0:1788925394.273901:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788925394.273904:0:8592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c846cbe400, rc 0) 00000100:00100000:0.0:1788925394.274028:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+11:11371:x1875823921484288:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 23830us (24106us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788925394.274039:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:3.0:1788925394.287201:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1788925394.287241:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.287257:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.287267:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.287276:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbee00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925394.287366:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.287377:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.287436:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb1bed465 (ffff98c8618c5700) 00010000:00010000:3.0:1788925394.287440:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925394.287446:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925394.287453:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925394.287515:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921484416 00000100:00100000:3.0:1788925394.287528:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921484416 00000100:00100000:3.0:1788925394.287575:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:3.0:1788925394.287586:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875823921484416:12345-192.168.204.28@tcp:8:llapi_scan_chan.0 00010000:00080000:3.0:1788925394.287630:0:6699:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:3.0:1788925394.287887:0:6699:0:(genops.c:1385:class_connect()) connect: client 5652db64-8dca-43c9-a8d1-41118f535cbb, cookie 0x503aa1a44b68e7df 00002000:00100000:3.0:1788925394.287903:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5652db64-8dca-43c9-a8d1-41118f535cbb/ffff98c848552000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788925394.287936:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788925394.288297:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788925394.288334:0:6699:0:(import.c:65:import_set_state_nolock()) ffff98c848557800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788925394.289869:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2357:x1875823921484416:12345-192.168.204.28@tcp:8:llapi_scan_chan.0 Request processed in 2274us (2674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925394.289886:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:0.0:1788925394.302248:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925394.304217:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921484544 00000100:00100000:2.0:1788925394.304238:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921484544 00000100:00100000:2.0:1788925394.304337:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:2.0:1788925394.304352:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c862fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:11371:x1875823921484544:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:2.0:1788925394.304376:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925394.304437:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004677dada/0x503aa1a44b68e7e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f78 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788925394.304474:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788925394.304515:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1788925394.304521:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925394.304533:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004677dada/0x503aa1a44b68e7e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f78 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925394.304558:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004677dada/0x503aa1a44b68e7e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f78 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925394.304576:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e444400, rc 0) 00000100:00100000:2.0:1788925394.305799:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c862fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+7:11371:x1875823921484544:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 314us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925394.305813:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00080000:2.0:1788925394.305954:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788925394.321364:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925394.321652:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921484672 00000100:00100000:1.0:1788925394.321677:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921484672 00002000:00100000:1.0:1788925394.321743:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->0) req@ffff98c87fcc0a80 x1875823921484672/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:470/0 lens 496/0 e 0 to 0 dl 1788925405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925394.321757:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87fcc0a80 with x1875823921484672 ext(0->0) 00002000:00010000:1.0:1788925394.321763:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87fcc0a80 00000100:00100000:1.0:1788925394.321798:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:1.0:1788925394.321810:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+7:2361:x1875823921484672:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000001:00100000:0.0:1788925394.374335:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5652db64-8dca-43c9-a8d1-41118f535cbb 00000001:00080000:0.0:1788925394.421305:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1788925394.421640:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921484672:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 99820us (100281us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788925394.421736:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00002000:00100000:2.0:1788925394.421758:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->0) req@ffff98c87fcc0a80 x1875823921484672/t4294967299(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:470/0 lens 496/448 e 0 to 0 dl 1788925405 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925394.421791:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87fcc0a80 with x1875823921484672 ext(0->0) 00002000:00010000:2.0:1788925394.421799:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87fcc0a80 00000100:00100000:0.0:1788925394.425980:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925394.427193:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921484800 00000100:00100000:2.0:1788925394.427208:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921484800 00000100:00100000:2.0:1788925394.427298:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:2.0:1788925394.427312:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+10:11371:x1875823921484800:12345-192.168.204.28@tcp:44:llapi_scan_chan.0 00000100:00100000:0.0:1788925394.548809:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+10:11371:x1875823921484800:12345-192.168.204.28@tcp:44:llapi_scan_chan.0 Request processed in 121483us (122827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925394.548836:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 40 00000001:00080000:1.0:1788925394.553470:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:0.0:1788925394.555112:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925394.555361:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921484928 00000100:00100000:3.0:1788925394.555377:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921484928 00000100:00100000:3.0:1788925394.555606:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:3.0:1788925394.555620:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921484928:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000100:00100000:3.0:1788925394.555959:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921484928:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 340us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925394.555968:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:0.0:1788925394.566683:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925394.567004:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921485056 00000100:00100000:1.0:1788925394.567019:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921485056 00002000:00100000:1.0:1788925394.567090:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->1) req@ffff98c87d3de300 x1875823921485056/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:470/0 lens 496/0 e 0 to 0 dl 1788925405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925394.567102:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87d3de300 with x1875823921485056 ext(0->1) 00002000:00010000:1.0:1788925394.567110:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87d3de300 00000100:00100000:1.0:1788925394.567156:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:1.0:1788925394.567168:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2358:x1875823921485056:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:1.0:1788925394.571536:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2358:x1875823921485056:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 4356us (4867us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788925394.571553:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00002000:00100000:1.0:1788925394.571578:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->1) req@ffff98c87d3de300 x1875823921485056/t4294967300(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:470/0 lens 496/448 e 0 to 0 dl 1788925405 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925394.571590:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87d3de300 with x1875823921485056 ext(0->1) 00002000:00010000:1.0:1788925394.571597:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87d3de300 00000100:00100000:3.0:1788925394.576784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925394.577302:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921485184 00000100:00100000:0.0:1788925394.577319:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921485184 00000100:00100000:0.0:1788925394.577446:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:0.0:1788925394.577460:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921485184:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788925394.743970:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1788925394.744549:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921485184:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 167081us (167768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925394.744564:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:3.0:1788925394.754135:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925394.754441:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921485312 00000100:00100000:2.0:1788925394.754456:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921485312 00002000:00100000:2.0:1788925394.754540:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->2) req@ffff98c87fcc2d80 x1875823921485312/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:470/0 lens 496/0 e 0 to 0 dl 1788925405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925394.754553:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87fcc2d80 with x1875823921485312 ext(0->2) 00002000:00010000:2.0:1788925394.754561:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87fcc2d80 00000100:00100000:2.0:1788925394.754599:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:2.0:1788925394.754610:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921485312:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925394.755248:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921485312:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 635us (1123us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788925394.755259:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00002000:00100000:2.0:1788925394.755268:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->2) req@ffff98c87fcc2d80 x1875823921485312/t4294967301(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:470/0 lens 496/448 e 0 to 0 dl 1788925405 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925394.755533:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87fcc2d80 with x1875823921485312 ext(0->2) 00002000:00010000:2.0:1788925394.755547:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87fcc2d80 00000100:00100000:0.0:1788925394.766101:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925394.766205:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921485440 00000100:00100000:3.0:1788925394.766230:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921485440 00000100:00100000:3.0:1788925394.766326:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:3.0:1788925394.766340:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921485440:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00010000:00010000:2.0:1788925394.774945:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925394.890907:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921485440:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 124553us (124806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925394.890925:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000001:00080000:0.0:1788925394.891168:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1788925394.901893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925394.902650:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921485568 00000100:00100000:2.0:1788925394.902665:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921485568 00002000:00100000:2.0:1788925394.902741:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->3) req@ffff98c875362680 x1875823921485568/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:470/0 lens 496/0 e 0 to 0 dl 1788925405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925394.902754:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c875362680 with x1875823921485568 ext(0->3) 00002000:00010000:2.0:1788925394.902761:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c875362680 00000100:00100000:2.0:1788925394.902799:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:2.0:1788925394.902811:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921485568:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925394.903535:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921485568:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 720us (1652us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788925394.903544:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00002000:00100000:2.0:1788925394.903555:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->3) req@ffff98c875362680 x1875823921485568/t4294967302(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:470/0 lens 496/448 e 0 to 0 dl 1788925405 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925394.903564:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c875362680 with x1875823921485568 ext(0->3) 00002000:00010000:2.0:1788925394.903569:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c875362680 00000100:00100000:2.0:1788925394.909391:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925394.909586:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921485696 00000100:00100000:0.0:1788925394.909600:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921485696 00000100:00100000:0.0:1788925394.909670:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:0.0:1788925394.909681:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921485696:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000100:00100000:3.0:1788925395.020007:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921485696:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 110308us (110615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925395.020025:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000001:00080000:0.0:1788925395.022011:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1788925395.026604:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925395.027225:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921485824 00000100:00100000:3.0:1788925395.027238:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921485824 00002000:00100000:3.0:1788925395.027315:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->4) req@ffff98c87ccf0000 x1875823921485824/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 496/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925395.027327:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87ccf0000 with x1875823921485824 ext(0->4) 00002000:00010000:3.0:1788925395.027334:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87ccf0000 00000100:00100000:3.0:1788925395.027370:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:3.0:1788925395.027381:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921485824:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788925395.028538:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921485824:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 1147us (1939us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788925395.028551:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00002000:00100000:3.0:1788925395.028567:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->4) req@ffff98c87ccf0000 x1875823921485824/t4294967303(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 496/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925395.028578:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87ccf0000 with x1875823921485824 ext(0->4) 00002000:00010000:3.0:1788925395.028584:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87ccf0000 00000100:00100000:2.0:1788925395.037680:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925395.038100:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921485952 00000100:00100000:3.0:1788925395.038114:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921485952 00000100:00100000:3.0:1788925395.038244:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:3.0:1788925395.038257:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921485952:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788925395.093333:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788925395.094278:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921485952:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 56003us (56595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925395.094295:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:2.0:1788925395.116725:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925395.117235:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921486080 00000100:00100000:1.0:1788925395.117251:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921486080 00002000:00100000:1.0:1788925395.117332:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->5) req@ffff98c87ccf3480 x1875823921486080/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 496/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925395.117345:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87ccf3480 with x1875823921486080 ext(0->5) 00002000:00010000:1.0:1788925395.117354:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87ccf3480 00000100:00100000:1.0:1788925395.117389:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:1.0:1788925395.117443:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921486080:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788925395.120915:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921486080:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 2573us (3265us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788925395.120938:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00002000:00100000:0.0:1788925395.120958:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->5) req@ffff98c87ccf3480 x1875823921486080/t4294967304(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 496/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788925395.120970:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87ccf3480 with x1875823921486080 ext(0->5) 00002000:00010000:0.0:1788925395.122136:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87ccf3480 00000100:00100000:2.0:1788925395.125919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925395.126129:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921486208 00000100:00100000:3.0:1788925395.126143:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921486208 00000100:00100000:3.0:1788925395.126224:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:3.0:1788925395.126238:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921486208:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000001:00080000:2.0:1788925395.179440:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:1.0:1788925395.179683:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921486208:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 53437us (53766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925395.179697:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:2.0:1788925395.191956:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925395.192692:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921486336 00000100:00100000:1.0:1788925395.192708:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921486336 00002000:00100000:1.0:1788925395.192779:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->6) req@ffff98c87ccf2d80 x1875823921486336/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 496/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925395.192792:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87ccf2d80 with x1875823921486336 ext(0->6) 00002000:00010000:1.0:1788925395.192799:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87ccf2d80 00000100:00100000:1.0:1788925395.192871:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:1.0:1788925395.192883:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921486336:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:1.0:1788925395.194740:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921486336:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 1842us (2787us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788925395.194756:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00002000:00100000:1.0:1788925395.194772:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->6) req@ffff98c87ccf2d80 x1875823921486336/t4294967305(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 496/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925395.194783:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87ccf2d80 with x1875823921486336 ext(0->6) 00002000:00010000:1.0:1788925395.194791:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87ccf2d80 00000100:00100000:2.0:1788925395.199809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925395.199938:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921486464 00000100:00100000:1.0:1788925395.199954:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921486464 00000100:00100000:1.0:1788925395.200159:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:1.0:1788925395.200172:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2359:x1875823921486464:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000001:00080000:2.0:1788925395.237599:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1788925395.238043:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921486464:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 37792us (38170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925395.238059:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:2.0:1788925395.251154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925395.251362:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921486592 00000100:00100000:0.0:1788925395.251380:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921486592 00002000:00100000:0.0:1788925395.251527:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->7) req@ffff98c87ccf2300 x1875823921486592/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 496/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788925395.251542:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87ccf2300 with x1875823921486592 ext(0->7) 00002000:00010000:0.0:1788925395.251550:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87ccf2300 00000100:00100000:0.0:1788925395.251592:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:0.0:1788925395.251606:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921486592:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788925395.253181:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921486592:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 1566us (2033us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788925395.253196:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00002000:00100000:0.0:1788925395.253211:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->7) req@ffff98c87ccf2300 x1875823921486592/t4294967306(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 496/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788925395.253222:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87ccf2300 with x1875823921486592 ext(0->7) 00002000:00010000:0.0:1788925395.253240:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87ccf2300 00000100:00100000:2.0:1788925395.262202:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925395.262330:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921486720 00000100:00100000:1.0:1788925395.262344:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921486720 00000100:00100000:1.0:1788925395.262458:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:1.0:1788925395.262472:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921486720:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000001:00080000:2.0:1788925395.326741:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:1.0:1788925395.327073:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921486720:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 64595us (64876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925395.327087:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:2.0:1788925395.348292:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925395.348528:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921486848 00000100:00100000:1.0:1788925395.348558:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921486848 00002000:00100000:1.0:1788925395.348633:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->8) req@ffff98c87ccf0e00 x1875823921486848/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925395.348646:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87ccf0e00 with x1875823921486848 ext(0->8) 00002000:00010000:1.0:1788925395.348653:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87ccf0e00 00000100:00100000:1.0:1788925395.348689:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:1.0:1788925395.348702:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921486848:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:1.0:1788925395.349469:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921486848:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 764us (1189us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788925395.349481:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00002000:00100000:1.0:1788925395.349500:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->8) req@ffff98c87ccf0e00 x1875823921486848/t4294967307(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925395.349510:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87ccf0e00 with x1875823921486848 ext(0->8) 00002000:00010000:1.0:1788925395.349514:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87ccf0e00 00000100:00100000:2.0:1788925395.360542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925395.360664:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921486976 00000100:00100000:1.0:1788925395.360679:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921486976 00000100:00100000:1.0:1788925395.360755:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:1.0:1788925395.360768:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87ccf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921486976:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000001:00080000:2.0:1788925395.427685:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:1.0:1788925395.427956:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87ccf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921486976:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 67182us (67422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925395.428883:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:0.0:1788925395.436677:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925395.437017:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921487104 00000100:00100000:2.0:1788925395.437031:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921487104 00002000:00100000:2.0:1788925395.437103:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->9) req@ffff98c87d3df800 x1875823921487104/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925395.437116:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87d3df800 with x1875823921487104 ext(0->9) 00002000:00010000:2.0:1788925395.437123:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87d3df800 00000100:00100000:2.0:1788925395.437167:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:2.0:1788925395.437180:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921487104:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925395.437892:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921487104:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 710us (1227us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788925395.437903:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00002000:00100000:2.0:1788925395.437911:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->9) req@ffff98c87d3df800 x1875823921487104/t4294967308(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925395.437920:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87d3df800 with x1875823921487104 ext(0->9) 00002000:00010000:2.0:1788925395.437924:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87d3df800 00000100:00100000:2.0:1788925395.443224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925395.445885:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921487232 00000100:00100000:1.0:1788925395.445907:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921487232 00000100:00100000:1.0:1788925395.446020:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:1.0:1788925395.446035:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c868ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2359:x1875823921487232:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788925395.514842:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788925395.515214:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c868ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921487232:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 69172us (71994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925395.515230:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:0.0:1788925395.522851:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925395.523455:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921487360 00000100:00100000:3.0:1788925395.523472:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921487360 00002000:00100000:3.0:1788925395.523556:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->10) req@ffff98c87d3df100 x1875823921487360/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925395.523569:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87d3df100 with x1875823921487360 ext(0->10) 00002000:00010000:3.0:1788925395.523577:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87d3df100 00000100:00100000:3.0:1788925395.523621:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1788925395.523633:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921487360:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788925395.526235:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921487360:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 624us (1420us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788925395.527188:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00002000:00100000:3.0:1788925395.527214:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->10) req@ffff98c87d3df100 x1875823921487360/t4294967309(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925395.527226:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87d3df100 with x1875823921487360 ext(0->10) 00002000:00010000:3.0:1788925395.527234:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87d3df100 00000100:00100000:1.0:1788925395.530699:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925395.530828:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921487488 00000100:00100000:3.0:1788925395.530843:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921487488 00000100:00100000:3.0:1788925395.530932:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:3.0:1788925395.530946:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2359:x1875823921487488:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000100:00100000:0.0:1788925395.572006:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925395.572082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925395.573468:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921487616 00000100:00100000:1.0:1788925395.573502:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921487616 00000100:00100000:1.0:1788925395.573593:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 252 00000100:00100000:1.0:1788925395.573606:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921487616:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788925395.573717:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9daa795-437c-4e56-9ebb-89af76979400+10:2359:x1875823921487616:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 112us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925395.573725:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 252 00000100:00100000:3.0:1788925395.574717:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921487744 00000100:00100000:3.0:1788925395.574731:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921487744 00000100:00100000:3.0:1788925395.574800:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 129 00000100:00100000:3.0:1788925395.574810:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2359:x1875823921487744:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925395.574898:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2359:x1875823921487744:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 78us (2802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925395.574907:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 129 00000100:00100000:2.0:1788925395.593528:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925395.593583:0:6701:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788925395.593595:0:6701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788925395.593739:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921487872 00000100:00100000:2.0:1788925395.593755:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921487872 00000100:00080000:2.0:1788925395.593862:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788925395.593970:0:12049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:2.0:1788925395.593984:0:12049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c868ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2357:x1875823921487872:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:2.0:1788925395.594026:0:12049:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x503aa1a44b68e6b2 00000100:00080000:2.0:1788925395.594040:0:12049:0:(import.c:65:import_set_state_nolock()) ffff98c87767a800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788925395.594070:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788925395.594097:0:12049:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788925395.594516:0:12049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c868ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+2:2357:x1875823921487872:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 531us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925395.594526:0:12049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00000001:00080000:0.0:1788925395.627522:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1788925395.627844:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2359:x1875823921487488:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 96891us (97151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925395.627859:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:2.0:1788925395.637274:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925395.637461:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921488000 00000100:00100000:1.0:1788925395.637487:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921488000 00002000:00100000:1.0:1788925395.637562:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->11) req@ffff98c868ba7b80 x1875823921488000/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925395.637574:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c868ba7b80 with x1875823921488000 ext(0->11) 00002000:00010000:1.0:1788925395.637580:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c868ba7b80 00000100:00100000:1.0:1788925395.637619:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:1.0:1788925395.637631:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c868ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921488000:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:1.0:1788925395.638513:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c868ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921488000:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 875us (1260us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788925395.638525:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00002000:00100000:1.0:1788925395.638535:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->11) req@ffff98c868ba7b80 x1875823921488000/t4294967310(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925395.638546:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c868ba7b80 with x1875823921488000 ext(0->11) 00002000:00010000:1.0:1788925395.638550:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c868ba7b80 00000100:00100000:0.0:1788925395.646365:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925395.646550:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921488128 00000100:00100000:2.0:1788925395.646564:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921488128 00000100:00100000:2.0:1788925395.646648:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:2.0:1788925395.646665:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d3dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921488128:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000100:00100000:3.0:1788925395.688534:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d3dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921488128:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 41853us (42165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925395.688551:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00000001:00080000:0.0:1788925395.689773:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:0.0:1788925395.698640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925395.699127:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921488256 00000100:00100000:3.0:1788925395.699142:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921488256 00002000:00100000:3.0:1788925395.699209:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff98c8482ded80 x1875823921488256/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925395.699247:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c8482ded80 with x1875823921488256 ext(0->12) 00002000:00010000:3.0:1788925395.699266:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c8482ded80 00000100:00100000:3.0:1788925395.699365:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:3.0:1788925395.699377:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921488256:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788925395.700109:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921488256:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 729us (1483us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788925395.700121:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00002000:00100000:3.0:1788925395.700131:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff98c8482ded80 x1875823921488256/t4294967311(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925395.700140:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c8482ded80 with x1875823921488256 ext(0->12) 00002000:00010000:3.0:1788925395.700144:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c8482ded80 00000100:00100000:3.0:1788925395.709700:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925395.709866:0:12049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921488384 00000100:00100000:2.0:1788925395.709883:0:12049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921488384 00000100:00100000:2.0:1788925395.709962:0:12049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:2.0:1788925395.709976:0:12049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921488384:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000100:00100000:3.0:1788925395.771389:0:12049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921488384:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 61398us (61691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925395.771431:0:12049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 30 00000001:00080000:1.0:1788925395.771539:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:0.0:1788925395.780354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925395.782545:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921488512 00000100:00100000:2.0:1788925395.782567:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921488512 00002000:00100000:2.0:1788925395.782663:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->13) req@ffff98c8482dc000 x1875823921488512/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925395.782676:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c8482dc000 with x1875823921488512 ext(0->13) 00002000:00010000:2.0:1788925395.782683:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c8482dc000 00000100:00100000:2.0:1788925395.782733:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:2.0:1788925395.782746:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921488512:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925395.783671:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921488512:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 922us (3326us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788925395.783682:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00002000:00100000:2.0:1788925395.783692:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->13) req@ffff98c8482dc000 x1875823921488512/t4294967312(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925395.783701:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c8482dc000 with x1875823921488512 ext(0->13) 00002000:00010000:2.0:1788925395.783706:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c8482dc000 00000100:00100000:0.0:1788925395.789937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925395.790104:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921488640 00000100:00100000:2.0:1788925395.790118:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921488640 00000100:00100000:2.0:1788925395.790192:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:2.0:1788925395.790205:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921488640:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00010000:00010000:1.0:1788925395.799969:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788925395.850992:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:0.0:1788925395.851345:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921488640:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 61133us (61415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925395.851361:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:0.0:1788925395.858247:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925395.858626:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921488768 00000100:00100000:3.0:1788925395.858643:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921488768 00002000:00100000:3.0:1788925395.858716:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->14) req@ffff98c8482dd180 x1875823921488768/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925395.858728:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c8482dd180 with x1875823921488768 ext(0->14) 00002000:00010000:3.0:1788925395.858735:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c8482dd180 00000100:00100000:3.0:1788925395.858779:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:3.0:1788925395.858792:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921488768:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788925395.859707:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921488768:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 910us (1469us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788925395.859717:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00002000:00100000:3.0:1788925395.859727:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->14) req@ffff98c8482dd180 x1875823921488768/t4294967313(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925395.859736:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c8482dd180 with x1875823921488768 ext(0->14) 00002000:00010000:3.0:1788925395.859741:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c8482dd180 00000100:00100000:1.0:1788925395.864597:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925395.864747:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921488896 00000100:00100000:3.0:1788925395.864761:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921488896 00000100:00100000:3.0:1788925395.864852:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:3.0:1788925395.864867:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921488896:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000100:00100000:2.0:1788925395.915724:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921488896:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 50844us (51125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925395.915743:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 32 00000001:00080000:0.0:1788925395.917034:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000100:00100000:0.0:1788925395.924786:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925395.925391:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921489024 00000100:00100000:1.0:1788925395.925438:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921489024 00002000:00100000:1.0:1788925395.925518:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->15) req@ffff98c8482df100 x1875823921489024/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925395.925530:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c8482df100 with x1875823921489024 ext(0->15) 00002000:00010000:1.0:1788925395.925537:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c8482df100 00000100:00100000:1.0:1788925395.925575:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:1.0:1788925395.925588:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921489024:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:1.0:1788925395.926820:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921489024:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 1224us (2038us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788925395.926834:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00002000:00100000:1.0:1788925395.926845:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->15) req@ffff98c8482df100 x1875823921489024/t4294967314(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 504/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925395.926856:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c8482df100 with x1875823921489024 ext(0->15) 00002000:00010000:1.0:1788925395.926860:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c8482df100 00000100:00100000:1.0:1788925395.933548:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925395.933664:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921489152 00000100:00100000:3.0:1788925395.933679:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921489152 00000100:00100000:3.0:1788925395.933756:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:3.0:1788925395.933768:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921489152:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788925395.962836:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1788925395.967525:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921489152:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 33743us (33978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925395.967542:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:3.0:1788925395.976631:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925395.976919:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921489280 00000100:00100000:2.0:1788925395.976937:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921489280 00002000:00100000:2.0:1788925395.977033:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->16) req@ffff98c87fcc1880 x1875823921489280/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 512/0 e 0 to 0 dl 1788925406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925395.977045:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87fcc1880 with x1875823921489280 ext(0->16) 00002000:00010000:2.0:1788925395.977051:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87fcc1880 00000100:00100000:2.0:1788925395.977092:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:2.0:1788925395.977103:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87fcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921489280:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925395.979340:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87fcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921489280:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 2220us (2704us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788925395.979358:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00002000:00100000:2.0:1788925395.979375:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->16) req@ffff98c87fcc1880 x1875823921489280/t4294967315(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:471/0 lens 512/448 e 0 to 0 dl 1788925406 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925395.979386:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c87fcc1880 with x1875823921489280 ext(0->16) 00002000:00010000:2.0:1788925395.979392:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c87fcc1880 00000100:00100000:2.0:1788925395.984846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925395.987202:0:12049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921489408 00000100:00100000:3.0:1788925395.987221:0:12049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921489408 00000100:00100000:3.0:1788925395.992921:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:3.0:1788925395.992942:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c868ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921489408:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788925396.079216:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788925396.079670:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c868ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921489408:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 86725us (94829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925396.079684:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:1.0:1788925396.088242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925396.092932:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921489536 00000100:00100000:2.0:1788925396.092961:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921489536 00002000:00100000:2.0:1788925396.093071:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->17) req@ffff98c875362a00 x1875823921489536/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:472/0 lens 512/0 e 0 to 0 dl 1788925407 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925396.093084:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c875362a00 with x1875823921489536 ext(0->17) 00002000:00010000:2.0:1788925396.093090:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c875362a00 00000100:00100000:2.0:1788925396.093134:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:2.0:1788925396.093146:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921489536:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00080000:0.0:1788925396.093804:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788925396.095082:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921489536:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 1727us (6646us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788925396.095099:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00002000:00100000:3.0:1788925396.095117:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->17) req@ffff98c875362a00 x1875823921489536/t4294967316(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:472/0 lens 512/448 e 0 to 0 dl 1788925407 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925396.095129:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c875362a00 with x1875823921489536 ext(0->17) 00002000:00010000:3.0:1788925396.095135:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c875362a00 00000100:00100000:1.0:1788925396.102924:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925396.103449:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921489664 00000100:00100000:0.0:1788925396.103465:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921489664 00000100:00100000:0.0:1788925396.103577:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:0.0:1788925396.103591:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921489664:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788925396.157492:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000100:00100000:0.0:1788925396.157574:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921489664:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 53977us (54659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925396.157607:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:2.0:1788925396.173130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.178902:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921489792 00000100:00100000:3.0:1788925396.178926:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921489792 00002000:00100000:3.0:1788925396.179018:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->18) req@ffff98c868ba6680 x1875823921489792/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:472/0 lens 512/0 e 0 to 0 dl 1788925407 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925396.179030:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c868ba6680 with x1875823921489792 ext(0->18) 00002000:00010000:3.0:1788925396.179037:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c868ba6680 00000100:00100000:3.0:1788925396.179137:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:3.0:1788925396.179150:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c868ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921489792:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788925396.179904:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c868ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921489792:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 749us (6784us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788925396.179915:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00002000:00100000:3.0:1788925396.179925:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->18) req@ffff98c868ba6680 x1875823921489792/t4294967317(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:472/0 lens 512/448 e 0 to 0 dl 1788925407 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925396.179936:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c868ba6680 with x1875823921489792 ext(0->18) 00002000:00010000:3.0:1788925396.179940:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c868ba6680 00000100:00100000:1.0:1788925396.186157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.186656:0:12049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921489920 00000100:00100000:3.0:1788925396.186690:0:12049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921489920 00000100:00100000:0.0:1788925396.186911:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:0.0:1788925396.186927:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921489920:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000001:00080000:2.0:1788925396.255205:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:2.0:1788925396.256177:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921489920:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 69240us (70019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925396.256192:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:2.0:1788925396.267503:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.269250:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921490048 00000100:00100000:3.0:1788925396.269269:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921490048 00002000:00100000:3.0:1788925396.269345:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->19) req@ffff98c868ba4e00 x1875823921490048/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:472/0 lens 512/0 e 0 to 0 dl 1788925407 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925396.269358:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c868ba4e00 with x1875823921490048 ext(0->19) 00002000:00010000:3.0:1788925396.269365:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c868ba4e00 00000100:00100000:3.0:1788925396.270731:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1788925396.273548:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c868ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2361:x1875823921490048:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925396.275665:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c868ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921490048:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 4898us (8159us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788925396.275681:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00002000:00100000:2.0:1788925396.275701:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->19) req@ffff98c868ba4e00 x1875823921490048/t4294967318(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:472/0 lens 512/448 e 0 to 0 dl 1788925407 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925396.275714:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c868ba4e00 with x1875823921490048 ext(0->19) 00002000:00010000:2.0:1788925396.275723:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c868ba4e00 00000100:00100000:0.0:1788925396.289576:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.289812:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921490176 00000100:00100000:3.0:1788925396.289825:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921490176 00000100:00100000:3.0:1788925396.289905:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:3.0:1788925396.289923:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2358:x1875823921490176:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788925396.363746:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:2.0:1788925396.365287:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2358:x1875823921490176:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 75351us (75710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925396.365303:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:1.0:1788925396.372749:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925396.373045:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921490432 00000100:00100000:2.0:1788925396.373060:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921490432 00000100:00100000:2.0:1788925396.373158:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:2.0:1788925396.373170:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c875360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+8:11371:x1875823921490432:12345-192.168.204.28@tcp:35:llapi_scan_chan.0 00000100:00080000:0.0:1788925396.374089:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788925396.375186:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967311 00000001:00080000:2.0:1788925396.375485:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:2.0:1788925396.375631:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c875360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+11:11371:x1875823921490432:12345-192.168.204.28@tcp:35:llapi_scan_chan.0 Request processed in 2456us (2892us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788925396.375644:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000020:00080000:2.0:1788925396.375651:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788925396.379071:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947740672:0@lo:400:kworker.0 00000100:00100000:3.0:1788925396.379162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925396.379279:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788925396.379287:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e7ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947740288:0@lo:400:kworker.0 00000100:00100000:3.0:1788925396.379322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925396.379349:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947740800:0@lo:400:kworker.0 00000100:00100000:3.0:1788925396.379379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925396.379436:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947740416:0@lo:400:kworker.0 00000100:00100000:3.0:1788925396.379475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925396.379494:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947740928:0@lo:400:kworker.0 00000100:00100000:3.0:1788925396.379522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925396.379538:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925396.379543:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947740544:0@lo:400:kworker.0 00000100:00100000:3.0:1788925396.379567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925396.379612:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947740288 00000100:00100000:3.0:1788925396.379620:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947740288 00000100:00100000:3.0:1788925396.379684:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788925396.379695:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947740288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925396.379733:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947740800 00000100:00100000:0.0:1788925396.379737:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947740800 00000100:00100000:3.0:1788925396.379752:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc4019aa-7bc2-4c01-afd8-dcb7596a337b+19:3305:x1875823947740288:12345-0@lo:400:kworker.0 Request processed in 58us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925396.379760:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788925396.379779:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947740416 00000100:00100000:0.0:1788925396.379782:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947740416 00000100:00100000:3.0:1788925396.379796:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947740544 00000100:00100000:3.0:1788925396.379799:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947740544 00000100:00100000:0.0:1788925396.379810:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788925396.379817:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947740800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925396.379819:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788925396.379824:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947740416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925396.379854:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823947740416:12345-0@lo:400:kworker.0 Request processed in 29us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925396.379855:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823947740800:12345-0@lo:400:kworker.0 Request processed in 39us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925396.379861:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1788925396.380459:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925396.380525:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823947740416:0@lo:400:kworker.0 00000100:00100000:1.0:1788925396.380560:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925396.380572:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947741056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925396.380621:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925396.380763:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947740672 00000100:00100000:2.0:1788925396.380770:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947740672 00000100:00100000:2.0:1788925396.380873:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947740928 00000100:00100000:2.0:1788925396.380877:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947740928 00000100:00080000:1.0:1788925396.383579:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788925396.383595:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925396.383876:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788925396.384376:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788925396.385162:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947740544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925396.385327:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823947740544:12345-0@lo:400:kworker.0 Request processed in 939us (5757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925396.385336:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788925396.385396:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947741056 00000100:00100000:0.0:1788925396.385438:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947741056 00000100:00100000:0.0:1788925396.385509:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788925396.385518:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875823947741056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925396.385558:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925396.385625:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875823947741056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (5003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925396.385632:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788925396.385937:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947741056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925396.385957:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823947740544:0@lo:400:kworker.0 00000100:00100000:0.0:1788925396.386051:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788925396.386065:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947740672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925396.386108:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947740672:12345-0@lo:400:kworker.0 Request processed in 48us (6947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925396.386126:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788925396.387320:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788925396.387333:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c874de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947740928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925396.387430:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c874de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823947740928:12345-0@lo:400:kworker.0 Request processed in 99us (7906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925396.387436:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788925396.387662:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875823947740928:0@lo:400:kworker.0 00000100:00100000:2.0:1788925396.387757:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e7ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc4019aa-7bc2-4c01-afd8-dcb7596a337b:3305:1875823947740288:0@lo:400:kworker.0 00000100:00100000:2.0:1788925396.387776:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823947740800:0@lo:400:kworker.0 00000100:00100000:2.0:1788925396.387788:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947740672:0@lo:400:kworker.0 00000100:00100000:1.0:1788925396.392318:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925396.392428:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921490560 00000100:00100000:0.0:1788925396.392441:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921490560 00000100:00100000:0.0:1788925396.392521:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:0.0:1788925396.392533:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+11:11371:x1875823921490560:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788925396.392566:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925396.392594:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f7f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.392695:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e7f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.392712:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e7f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.392730:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e7f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.392751:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e7fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.392758:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e7fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.392778:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e7fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.393380:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e7f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.393392:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e7f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.393648:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e7f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.393657:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbf200 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:0.0:1788925396.393664:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e7f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.393673:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e7f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.393691:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c8709b8000) 00010000:00010000:0.0:1788925396.393694:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925396.393701:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e7f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.396782:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e7f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.396816:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e7fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.396823:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e7fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.396858:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e7fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.396865:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbfc00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:0.0:1788925396.396871:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e7fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.396881:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e7fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.396902:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x53c112bd (ffff98c8618c5f00) 00010000:00010000:0.0:1788925396.397207:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925396.397216:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e7fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.397224:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e7fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.397305:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ed lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f7f expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.397318:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c8709b8000) 00010000:00010000:0.0:1788925396.397321:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925396.397325:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e7ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f7f expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.397335:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c846cbee00, rc 0) 00000100:00100000:0.0:1788925396.397699:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+11:11371:x1875823921490560:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 5164us (5393us total) trans 0 rc 301/301 00000100:00100000:0.0:1788925396.397724:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:1.0:1788925396.407967:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925396.414063:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921490816 00000100:00100000:0.0:1788925396.414081:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921490816 00000100:00100000:0.0:1788925396.414159:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:0.0:1788925396.414171:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87cefce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+11:11371:x1875823921490816:12345-192.168.204.28@tcp:36:llapi_scan_chan.0 00010000:00010000:0.0:1788925396.414243:0:5860:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925396.414282:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe400/0x503aa1a44b68e7d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f71 expref: 11 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.414306:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff98c8618c5000) 00010000:00010000:0.0:1788925396.414318:0:5860:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788925396.414358:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e802 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.414375:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e802 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.414385:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e802 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.414445:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e809 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.414454:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.414462:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.414517:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e810 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.414526:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.414533:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.415134:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf800/0x503aa1a44b68e817 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.415147:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf800/0x503aa1a44b68e817 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.415155:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf800/0x503aa1a44b68e817 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788925396.416259:0:5860:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d0bc6e8 reply state 00000000cab7c2b5 transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf800/0x503aa1a44b68e817 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925396.416276:0:5860:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788925396.416285:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e802 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.416292:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e802 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.416300:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e802 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.416307:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbee00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:0.0:1788925396.416321:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e802 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.416330:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e802 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.416346:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c8709b8000) 00010000:00010000:0.0:1788925396.416350:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925396.416355:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e802 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.416362:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbee00/0x503aa1a44b68e802 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788925396.416376:0:5860:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d0bc6e8 reply state 00000000cab7c2b5 transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925396.416383:0:5860:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00010000:0.0:1788925396.416388:0:5860:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d0bc6e8 reply state 00000000cab7c2b5 transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925396.416393:0:5860:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1788925396.416597:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87cefce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+12:11371:x1875823921490816:12345-192.168.204.28@tcp:36:llapi_scan_chan.0 Request processed in 2419us (8641us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788925396.416609:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00010000:00010000:1.0:1788925396.424215:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424242:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e810 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424252:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424259:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbf200 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:1.0:1788925396.424267:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424276:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e810 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424300:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb1bed465 (ffff98c8618c5200) 00010000:00010000:1.0:1788925396.424304:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925396.424310:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e810 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424341:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf200/0x503aa1a44b68e810 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424370:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424376:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e809 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424382:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e809 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424388:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbfc00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:1.0:1788925396.424391:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e809 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424397:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e809 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424440:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x53c112bd (ffff98c8618c5f00) 00010000:00010000:1.0:1788925396.424442:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925396.424446:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e809 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424451:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbfc00/0x503aa1a44b68e809 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424476:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf800/0x503aa1a44b68e817 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424483:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf800/0x503aa1a44b68e817 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424496:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf800/0x503aa1a44b68e817 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424501:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c846cbf800 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:1.0:1788925396.424504:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf800/0x503aa1a44b68e817 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424511:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf800/0x503aa1a44b68e817 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424520:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff98c8618c5800) 00010000:00010000:1.0:1788925396.424523:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788925396.424525:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf800/0x503aa1a44b68e817 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.424531:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf800/0x503aa1a44b68e817 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925396.429143:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.430862:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921490944 00000100:00100000:3.0:1788925396.430886:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921490944 00000100:00100000:3.0:1788925396.431014:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:3.0:1788925396.431029:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+11:11371:x1875823921490944:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788925396.431071:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925396.431104:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e81e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f86 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431210:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e825 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431229:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431244:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431286:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe800/0x503aa1a44b68e82c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431295:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe800/0x503aa1a44b68e82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431302:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe800/0x503aa1a44b68e82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431691:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431702:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431710:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925396.431756:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 20 00000004:00200000:3.0:1788925396.431762:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788925396.431786:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431800:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431809:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431816:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e825 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431836:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e825 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431844:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8413fe400 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925396.431849:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e825 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431859:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e825 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431875:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c8709b8000) 00010000:00010000:3.0:1788925396.431879:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925396.431884:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e825 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431891:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e825 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431908:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe800/0x503aa1a44b68e82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431915:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe800/0x503aa1a44b68e82c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431921:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe800/0x503aa1a44b68e82c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431926:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8413fe800 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925396.431929:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe800/0x503aa1a44b68e82c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431945:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe800/0x503aa1a44b68e82c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431953:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x53c112bd (ffff98c862acaf00) 00010000:00010000:3.0:1788925396.431955:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925396.431958:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe800/0x503aa1a44b68e82c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.431964:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe800/0x503aa1a44b68e82c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.432002:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e81e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f86 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.432019:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f86 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.432027:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff98c862acab00) 00010000:00010000:3.0:1788925396.432029:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788925396.432031:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8413fec00, rc 0) 00000100:00100000:3.0:1788925396.432134:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+12:11371:x1875823921490944:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 1108us (3006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925396.432143:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:0.0:1788925396.440967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925396.441106:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921491200 00000100:00100000:1.0:1788925396.441122:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921491200 00000100:00100000:1.0:1788925396.441212:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:1.0:1788925396.441225:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+12:11371:x1875823921491200:12345-192.168.204.28@tcp:36:llapi_scan_chan.0 00010000:00010000:1.0:1788925396.441300:0:8592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925396.441337:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e833 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f86 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.441365:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff98c862acab00) 00010000:00010000:1.0:1788925396.441379:0:8592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788925396.441622:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e83a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.441638:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e83a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.441649:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e83a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.441666:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e841 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.441673:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.441680:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.442036:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e848 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.442046:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e848 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.442054:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e848 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788925396.443299:0:8592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788925396.443316:0:8592:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385571914285ns, next at 386571910715ns, rc = 0 00010000:00010000:1.0:1788925396.443544:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e84f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443562:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e84f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443582:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e84f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443592:0:8592:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e84f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443600:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e84f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443606:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e84f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443710:0:8592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788925396.443742:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e848 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443750:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e848 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443756:0:8592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e848 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443763:0:8592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861867200 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:1.0:1788925396.443769:0:8592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e848 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443777:0:8592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e848 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443793:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff98c8709b8e00) 00010000:00010000:1.0:1788925396.443797:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788925396.443809:0:8592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e848 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443816:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e848 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443844:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e83a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443852:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e83a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443858:0:8592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e83a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443864:0:8592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861866000 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:1.0:1788925396.443867:0:8592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e83a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443873:0:8592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e83a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443882:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c8709b8000) 00010000:00010000:1.0:1788925396.443884:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925396.443887:0:8592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e83a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.443892:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866000/0x503aa1a44b68e83a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788925396.443915:0:8592:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005198831e reply state 00000000937e316f transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925396.443938:0:8592:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788925396.444082:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+13:11371:x1875823921491200:12345-192.168.204.28@tcp:36:llapi_scan_chan.0 Request processed in 2851us (3424us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788925396.444093:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 43 00010000:00010000:3.0:1788925396.446714:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.446738:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e841 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.446772:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e841 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.446780:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861867800 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925396.446798:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e841 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.446808:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e841 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.446830:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x53c112bd (ffff98c8709b8b00) 00010000:00010000:3.0:1788925396.446834:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925396.446839:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e841 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.446846:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867800/0x503aa1a44b68e841 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.447950:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925396.447966:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e84f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.447977:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861866e00 already unused, calling callback (ffffffffc15c6230) 00010000:00010000:2.0:1788925396.447982:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e84f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.447991:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e84f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.448007:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff98c8709b8e00) 00010000:00010000:2.0:1788925396.448011:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788925396.448015:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e84f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.448043:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866e00/0x503aa1a44b68e84f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.448072:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925396.448074:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925396.448076:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925396.457511:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.457772:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921491456 00000100:00100000:3.0:1788925396.457786:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921491456 00000100:00100000:3.0:1788925396.457870:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:3.0:1788925396.457881:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+12:11371:x1875823921491456:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788925396.457917:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925396.457946:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e856 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f8d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925396.458129:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1788925396.458301:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e856 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f8d expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.458345:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c862acae00) 00010000:00010000:3.0:1788925396.458349:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788925396.458356:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e856 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f8d expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.458377:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8413ff400, rc 0) 00000100:00100000:3.0:1788925396.458965:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+13:11371:x1875823921491456:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 1079us (1480us total) trans 4294967316 rc 301/301 00000100:00100000:3.0:1788925396.458975:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:1.0:1788925396.463984:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925396.464258:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921491712 00000100:00100000:2.0:1788925396.464272:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921491712 00000100:00100000:2.0:1788925396.464351:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1788925396.464364:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+13:11371:x1875823921491712:12345-192.168.204.28@tcp:35:llapi_scan_chan.0 00000100:00100000:2.0:1788925396.465434:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+14:11371:x1875823921491712:12345-192.168.204.28@tcp:35:llapi_scan_chan.0 Request processed in 1032us (1428us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788925396.465448:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:1.0:1788925396.474483:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925396.475013:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921491840 00000100:00100000:0.0:1788925396.475028:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921491840 00000100:00100000:0.0:1788925396.475125:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:0.0:1788925396.475138:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+14:11373:x1875823921491840:12345-192.168.204.28@tcp:53:llapi_scan_chan.0 00000004:00000080:0.0:1788925396.475206:0:5848:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff98c85804d158 00000040:00080000:1.0:1788925396.477048:0:5848:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788925396.477063:0:5848:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1788925396.477177:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788925396.477186:0:5848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:1.0:1788925396.477459:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+14:11373:x1875823921491840:12345-192.168.204.28@tcp:53:llapi_scan_chan.0 Request processed in 2314us (3048us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788925396.477484:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:0.0:1788925396.504206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.504475:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921491968 00000100:00100000:3.0:1788925396.504493:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921491968 00000100:00100000:3.0:1788925396.504629:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:3.0:1788925396.504642:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+14:11374:x1875823921491968:12345-192.168.204.28@tcp:53:llapi_scan_chan.0 00000004:00000080:3.0:1788925396.504936:0:5847:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff98c85804d280 00000040:00080000:3.0:1788925396.505049:0:5847:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788925396.505054:0:5847:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1788925396.505086:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788925396.505092:0:5847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1788925396.505261:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+14:11374:x1875823921491968:12345-192.168.204.28@tcp:53:llapi_scan_chan.0 Request processed in 618us (1069us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788925396.505270:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:2.0:1788925396.518524:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925396.518798:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921492096 00000100:00100000:1.0:1788925396.518815:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921492096 00000100:00100000:1.0:1788925396.518915:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:1.0:1788925396.518929:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c868ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+14:11375:x1875823921492096:12345-192.168.204.28@tcp:53:llapi_scan_chan.0 00000004:00000080:1.0:1788925396.518981:0:8592:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff98c85804d3a8 00000040:00080000:1.0:1788925396.519102:0:8592:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788925396.519109:0:8592:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1788925396.519143:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788925396.519151:0:8592:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:1.0:1788925396.519258:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c868ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+14:11375:x1875823921492096:12345-192.168.204.28@tcp:53:llapi_scan_chan.0 Request processed in 331us (760us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788925396.519267:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:1.0:1788925396.531352:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.531758:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921492224 00000100:00100000:3.0:1788925396.531771:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921492224 00000100:00100000:3.0:1788925396.531847:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:3.0:1788925396.532002:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+14:11376:x1875823921492224:12345-192.168.204.28@tcp:53:llapi_scan_chan.0 00000004:00000080:3.0:1788925396.532053:0:5847:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff98c85804d4d0 00000040:00080000:3.0:1788925396.532163:0:5847:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788925396.532168:0:5847:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1788925396.532198:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788925396.532205:0:5847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1788925396.532307:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+14:11376:x1875823921492224:12345-192.168.204.28@tcp:53:llapi_scan_chan.0 Request processed in 449us (967us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788925396.532316:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:2.0:1788925396.545223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925396.545579:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921492480 00000100:00100000:1.0:1788925396.545596:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921492480 00000100:00100000:1.0:1788925396.545675:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:1.0:1788925396.545687:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c868ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+14:11378:x1875823921492480:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:1.0:1788925396.545716:0:8592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925396.545742:0:8592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867e00/0x503aa1a44b68e864 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f94 expref: -99 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.545948:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e86b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.545968:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e86b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.545982:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e86b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.546004:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867c00/0x503aa1a44b68e872 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.546012:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867c00/0x503aa1a44b68e872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.546018:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867c00/0x503aa1a44b68e872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788925396.547382:0:8592:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788925396.548606:0:8592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.548634:0:8592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.548664:0:8592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.548720:0:8592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e86b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.548729:0:8592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e86b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.548737:0:8592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e86b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.548744:0:8592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861866c00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:1.0:1788925396.548750:0:8592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e86b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.548758:0:8592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e86b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.548773:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c8709b8000) 00010000:00010000:1.0:1788925396.548777:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925396.548783:0:8592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e86b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.548864:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861866c00/0x503aa1a44b68e86b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788925396.548891:0:8592:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000237b60eb reply state 00000000f5b16276 transno 4294967318 ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867c00/0x503aa1a44b68e872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925396.548903:0:8592:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788925396.548961:0:8592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867e00/0x503aa1a44b68e864 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f94 expref: 17 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.548982:0:8592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f94 expref: 16 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.548991:0:8592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c8709b8d00) 00010000:00010000:1.0:1788925396.548994:0:8592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788925396.548997:0:8592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c861867200, rc 0) 00000100:00100000:1.0:1788925396.549190:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c868ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+17:11378:x1875823921492480:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 3503us (3984us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788925396.549201:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:2.0:1788925396.558115:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.558800:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921492736 00000100:00100000:3.0:1788925396.558817:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921492736 00000100:00100000:3.0:1788925396.558903:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:3.0:1788925396.558917:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c868ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+17:11378:x1875823921492736:12345-192.168.204.28@tcp:35:llapi_scan_chan.0 00000001:00080000:3.0:1788925396.559893:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000100:00100000:3.0:1788925396.560210:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c868ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+19:11378:x1875823921492736:12345-192.168.204.28@tcp:35:llapi_scan_chan.0 Request processed in 1289us (2105us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788925396.560224:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000020:00080000:3.0:1788925396.560231:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788925396.560568:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867c00/0x503aa1a44b68e872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.560586:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867c00/0x503aa1a44b68e872 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.560595:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867c00/0x503aa1a44b68e872 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.560602:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c861867c00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:1.0:1788925396.560608:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867c00/0x503aa1a44b68e872 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.560618:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867c00/0x503aa1a44b68e872 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.560642:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x37779e05 (ffff98c8709b8200) 00010000:00010000:1.0:1788925396.560646:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925396.560676:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867c00/0x503aa1a44b68e872 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.560683:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867c00/0x503aa1a44b68e872 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8592 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925396.565360:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925396.565765:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921492992 00000100:00100000:2.0:1788925396.565779:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921492992 00000100:00100000:2.0:1788925396.565962:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:2.0:1788925396.565976:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+18:11378:x1875823921492992:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:2.0:1788925396.566013:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925396.566044:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e887 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1f9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.566233:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e88e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.566288:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e88e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.566302:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e88e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.566323:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e895 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.566331:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.566338:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788925396.567292:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788925396.568035:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e89c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.568054:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e89c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.568068:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e89c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.568117:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e88e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.568125:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e88e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.568133:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e88e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.568150:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e444000 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925396.568155:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e88e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.568164:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e88e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.568180:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c8709b8000) 00010000:00010000:2.0:1788925396.568183:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925396.568188:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e88e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.568194:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444000/0x503aa1a44b68e88e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788925396.568212:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049099104 reply state 0000000033aa388e transno 4294967321 ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925396.568223:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788925396.568280:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444c00/0x503aa1a44b68e887 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f9b expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.568295:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e444800/0x503aa1a44b68e89c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f9b expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.568302:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c85078ea00) 00010000:00010000:2.0:1788925396.568305:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788925396.568307:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e444800, rc 0) 00000100:00100000:2.0:1788925396.568810:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+21:11378:x1875823921492992:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 2834us (3460us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788925396.568830:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:0.0:1788925396.574356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925396.574974:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921493248 00000100:00100000:2.0:1788925396.574988:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921493248 00000100:00100000:2.0:1788925396.575077:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:2.0:1788925396.575090:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+21:11378:x1875823921493248:12345-192.168.204.28@tcp:35:llapi_scan_chan.0 00010000:00010000:3.0:1788925396.575967:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.575984:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e895 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.575993:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.576000:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e445600 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:3.0:1788925396.576006:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.576035:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e895 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.576057:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7b008030 (ffff98c85078ef00) 00010000:00010000:3.0:1788925396.576060:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925396.576066:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e895 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.576073:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c86e445600/0x503aa1a44b68e895 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788925396.576333:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788925396.578109:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+22:11378:x1875823921493248:12345-192.168.204.28@tcp:35:llapi_scan_chan.0 Request processed in 3005us (3755us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788925396.578125:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000020:00080000:2.0:1788925396.578134:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788925396.583009:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925396.583141:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921493504 00000100:00100000:0.0:1788925396.583156:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921493504 00000100:00100000:0.0:1788925396.583284:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:0.0:1788925396.583296:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+22:11378:x1875823921493504:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788925396.583332:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925396.583362:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf000/0x503aa1a44b68e8aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1fa2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.583753:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.583773:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e879 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f94 expref: 23 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.583782:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.583843:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f94 expref: 23 pid: 8592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925396.583864:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f94 expref: 23 pid: 8592 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925396.583882:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c8482dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1875823947741184:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788925396.584020:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c846ca1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788925396.587678:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c8482dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1875823947741184:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788925396.587723:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925396.591175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.591677:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921493632 00000100:00100000:3.0:1788925396.591691:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921493632 00010000:00010000:3.0:1788925396.591748:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f94 expref: 24 pid: 8592 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925396.591807:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:3.0:1788925396.591820:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c87d1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+24:2361:x1875823921493632:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788925396.591839:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925396.591847:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f94 expref: 24 pid: 8592 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.591866:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f94 expref: 24 pid: 8592 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.591893:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c861867200/0x503aa1a44b68e879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f94 expref: 24 pid: 8592 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.591941:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c8709b8d00) 00010000:00010000:3.0:1788925396.591948:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.591958:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.591967:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.592006:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925396.592094:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+23:2361:x1875823921493632:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 276us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925396.592104:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00010000:00010000:2.0:1788925396.592482:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.592493:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925396.592528:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 0 00010000:00010000:2.0:1788925396.592741:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbf000/0x503aa1a44b68e8aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fa2 expref: 24 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.592760:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fa2 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.592782:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c8709b8d00) 00010000:00010000:2.0:1788925396.592799:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788925396.592803:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c846cbe600, rc 0) 00000100:00100000:2.0:1788925396.592845:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c87d1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+23:11378:x1875823921493504:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 9550us (9853us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788925396.592853:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:0.0:1788925396.603052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.603161:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921493760 00000100:00100000:3.0:1788925396.603176:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921493760 00000100:00100000:3.0:1788925396.603258:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:3.0:1788925396.603271:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+23:11378:x1875823921493760:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788925396.603307:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925396.603334:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e8bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1fa9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.603477:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e8bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fa9 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.603495:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ff400/0x503aa1a44b68e8bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fa9 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.603547:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c8709b8d00) 00010000:00010000:3.0:1788925396.603550:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788925396.603554:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8413ff400, rc 0) 00000100:00100000:3.0:1788925396.603642:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+24:11378:x1875823921493760:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 374us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925396.603651:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:0.0:1788925396.618364:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925396.618648:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921493888 00000100:00100000:2.0:1788925396.618663:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921493888 00000100:00100000:2.0:1788925396.618736:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:2.0:1788925396.618750:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875823921493888:12345-192.168.204.28@tcp:8:llapi_scan_chan.0 00010000:00080000:2.0:1788925396.618812:0:6702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:2.0:1788925396.618862:0:6702:0:(genops.c:1385:class_connect()) connect: client 5652db64-8dca-43c9-a8d1-41118f535cbb, cookie 0x503aa1a44b68e8c6 00002000:00100000:2.0:1788925396.618881:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5652db64-8dca-43c9-a8d1-41118f535cbb/ffff98c86e4f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788925396.618897:0:6702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788925396.619069:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788925396.619118:0:6702:0:(import.c:65:import_set_state_nolock()) ffff98c86e4f7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925396.619208:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2357:x1875823921493888:12345-192.168.204.28@tcp:8:llapi_scan_chan.0 Request processed in 458us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925396.619218:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:1.0:1788925396.638507:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925396.638780:0:12049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921494016 00000100:00100000:2.0:1788925396.638797:0:12049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921494016 00000100:00100000:2.0:1788925396.638891:0:12049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:2.0:1788925396.638904:0:12049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:11378:x1875823921494016:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:2.0:1788925396.638932:0:12049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925396.638988:0:12049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dfbe367/0x503aa1a44b68e8cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1fb0 expref: -99 pid: 12049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788925396.639037:0:12049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788925396.639069:0:12049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1788925396.639074:0:12049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925396.639085:0:12049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dfbe367/0x503aa1a44b68e8cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fb0 expref: 7 pid: 12049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.639108:0:12049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003dfbe367/0x503aa1a44b68e8cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fb0 expref: 7 pid: 12049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.639126:0:12049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c86e444000, rc 0) 00000100:00100000:2.0:1788925396.639212:0:12049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+7:11378:x1875823921494016:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 310us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925396.639221:0:12049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00080000:1.0:1788925396.639659:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925396.649017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.649141:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921494144 00000100:00100000:3.0:1788925396.649154:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921494144 00002000:00100000:3.0:1788925396.649676:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->0) req@ffff98c86e756680 x1875823921494144/t0(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:472/0 lens 496/0 e 0 to 0 dl 1788925407 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925396.649690:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c86e756680 with x1875823921494144 ext(0->0) 00002000:00010000:3.0:1788925396.649697:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c86e756680 00000100:00100000:1.0:1788925396.649834:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:1.0:1788925396.649851:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+7:2360:x1875823921494144:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 00000001:00100000:0.0:1788925396.735690:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5652db64-8dca-43c9-a8d1-41118f535cbb 00000001:00100000:0.0:1788925396.735711:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5652db64-8dca-43c9-a8d1-41118f535cbb 00000020:00000080:0.0:1788925396.735716:0:6725:0:(genops.c:885:class_export_put()) final put ffff98c87767e800/5652db64-8dca-43c9-a8d1-41118f535cbb 00000020:00000080:3.0:1788925396.735807:0:1375:0:(genops.c:844:class_export_destroy()) destroying export ffff98c87767e800/5652db64-8dca-43c9-a8d1-41118f535cbb for lustre-OST0000 00000020:00000080:3.0:1788925396.735887:0:1375:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c87767a800 for lustre-OST0000 00000100:00100000:1.0:1788925396.737227:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2360:x1875823921494144:12345-192.168.204.28@tcp:4:llapi_scan_chan.0 Request processed in 87371us (88214us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788925396.737244:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00002000:00100000:1.0:1788925396.737265:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->0) req@ffff98c86e756680 x1875823921494144/t4294967301(0) o4->5652db64-8dca-43c9-a8d1-41118f535cbb@192.168.204.28@tcp:472/0 lens 496/448 e 0 to 0 dl 1788925407 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788925396.737278:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c86e756680 with x1875823921494144 ext(0->0) 00002000:00010000:1.0:1788925396.737286:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98c86e756680 00000100:00100000:3.0:1788925396.745254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788925396.748627:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921494272 00000100:00100000:1.0:1788925396.748656:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921494272 00000100:00100000:1.0:1788925396.749618:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:1.0:1788925396.749638:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+24:11378:x1875823921494272:12345-192.168.204.28@tcp:44:llapi_scan_chan.0 00010000:00010000:3.0:1788925396.823325:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788925396.829039:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967314 is committed 00000001:00080000:3.0:1788925396.829068:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967318 is committed 00000004:00080000:3.0:1788925396.829079:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788925396.829102:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967324 is committed 00000100:00100000:3.0:1788925396.829450:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c868ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947741312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788925396.829568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925396.829703:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947741312 00000100:00100000:2.0:1788925396.829714:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947741312 00000100:00100000:2.0:1788925396.829791:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788925396.829803:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823947741312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788925396.829842:0:6702:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00010000:00010000:2.0:1788925396.829878:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.829908:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004677dada/0x503aa1a44b68e7e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f78 expref: 5 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.829943:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788925396.829948:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788925396.829955:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.829992:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004677dada/0x503aa1a44b68e7e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f78 expref: 5 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.830017:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004677dada/0x503aa1a44b68e7e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f78 expref: 5 pid: 6701 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925396.830032:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c868ba7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1875823947741440:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788925396.830111:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c86e5e5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788925396.830876:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+10:11378:x1875823921494272:12345-192.168.204.28@tcp:44:llapi_scan_chan.0 Request processed in 81240us (85630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925396.830901:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:0.0:1788925396.841956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925396.842038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.842136:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c868ba7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1875823947741440:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788925396.842180:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925396.842474:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921494400 00000100:00100000:1.0:1788925396.842484:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921494400 00010000:00010000:1.0:1788925396.842533:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004677dada/0x503aa1a44b68e7e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f78 expref: 6 pid: 6701 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925396.842572:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:1.0:1788925396.842584:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c8482dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2360:x1875823921494400:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788925396.842605:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925396.842612:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004677dada/0x503aa1a44b68e7e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f78 expref: 6 pid: 6701 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.842631:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004677dada/0x503aa1a44b68e7e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f78 expref: 6 pid: 6701 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.842666:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004677dada/0x503aa1a44b68e7e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1f78 expref: 6 pid: 6701 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.842689:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788925396.842694:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788925396.842702:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.842714:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.842759:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925396.842841:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c8482dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2360:x1875823921494400:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 258us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925396.842850:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 30 00010000:00010000:1.0:1788925396.843012:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.843023:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.843034:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.843043:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.843066:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788925396.844200:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875823947741312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14393us (14626us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788925396.844213:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1788925396.845118:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c868ba4a80/2, rc 0, transno 4294967319 00000100:00100000:2.0:1788925396.845130:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c868ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875823947741312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788925396.846083:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921494528 00000100:00100000:1.0:1788925396.846099:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921494528 00000100:00100000:1.0:1788925396.846175:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:1.0:1788925396.846186:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921494528:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 00010000:00010000:1.0:1788925396.846289:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925396.846316:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.846333:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c86e444600 already unused, calling callback (ffffffffc15c6230) 00010000:00010000:1.0:1788925396.846339:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.846352:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.846378:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.846387:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001f1ea17/0x503aa1a44b68e8d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925396.846434:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925396.846436:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925396.846438:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925396.893186:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e48ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947741568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925396.893303:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925396.893420:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823947741568 00000100:00100000:2.0:1788925396.893430:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823947741568 00000100:00100000:2.0:1788925396.893506:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788925396.893518:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c868ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875823947741568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925396.893552:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78315520 pending 0 free 3859808256 avail 3852468224 00000100:00100000:2.0:1788925396.893606:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c868ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875823947741568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925396.893628:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788925396.893702:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e48ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875823947741568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925396.906316:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+8:2361:x1875823921494528:12345-192.168.204.28@tcp:16:llapi_scan_chan.0 Request processed in 60111us (64258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925396.906333:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00000001:00080000:0.0:1788925396.913364:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1788925396.916384:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.916590:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921494656 00000100:00100000:3.0:1788925396.916603:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921494656 00000100:00100000:3.0:1788925396.916686:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:3.0:1788925396.916700:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+10:11378:x1875823921494656:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788925396.916730:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925396.916763:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe800/0x503aa1a44b68e8db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6f32039fbd3b1fb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.916869:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e8e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.916888:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.916987:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.917010:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e8e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.917018:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.917025:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.918194:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e8f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.918245:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fa2 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.918257:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e8f0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.918314:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fa2 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.918344:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fa2 expref: 11 pid: 5848 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925396.918363:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98c86e7adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1875823947741696:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788925396.918568:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff98c861582f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788925396.924950:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98c86e7adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1875823947741696:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788925396.924995:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e8f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925396.925630:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.925792:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921494912 00000100:00100000:3.0:1788925396.925803:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921494912 00000100:00100000:3.0:1788925396.925878:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1788925396.925891:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c858155850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+12:5604:x1875823921494912:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000001:00080000:3.0:1788925396.927157:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:3.0:1788925396.928323:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c858155850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+14:5604:x1875823921494912:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 2421us (2682us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788925396.928338:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000020:00080000:3.0:1788925396.928363:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788925396.937765:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925396.937996:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921495040 00000100:00100000:3.0:1788925396.938011:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921495040 00010000:00010000:3.0:1788925396.938068:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fa2 expref: 14 pid: 5848 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925396.938158:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:3.0:1788925396.938171:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+14:2360:x1875823921495040:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788925396.938191:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925396.938201:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fa2 expref: 14 pid: 5848 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.938223:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fa2 expref: 14 pid: 5848 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.938265:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c846cbe600/0x503aa1a44b68e8b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fa2 expref: 14 pid: 5848 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.938286:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c8709b8d00) 00010000:00010000:3.0:1788925396.938293:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e8f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.938305:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.938314:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e8f0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925396.938352:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925396.938619:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+13:2360:x1875823921495040:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 449us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925396.938649:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 31 00010000:00010000:2.0:1788925396.938728:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938739:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925396.938805:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 1 00000004:00200000:2.0:1788925396.938811:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788925396.938835:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938851:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938862:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938869:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e8e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938877:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e8e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938883:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8413fe400 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925396.938888:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e8e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938915:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e8e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938928:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c8709b8000) 00010000:00010000:2.0:1788925396.938931:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925396.938937:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e8e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938944:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe400/0x503aa1a44b68e8e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938958:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938965:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e8e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938973:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938979:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c8413fec00 already unused, calling callback (ffffffffc20054f0) 00010000:00010000:2.0:1788925396.938982:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938987:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e8e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.938994:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x37779e05 (ffff98c862acad00) 00010000:00010000:2.0:1788925396.938996:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925396.938999:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e8e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.939015:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fec00/0x503aa1a44b68e8e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.939059:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413fe800/0x503aa1a44b68e8db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fb7 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.939075:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c8413ffa00/0x503aa1a44b68e8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x6f32039fbd3b1fb7 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925396.939083:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c8709b8d00) 00010000:00010000:2.0:1788925396.939085:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788925396.939088:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c8413ffa00, rc 0) 00000100:00100000:2.0:1788925396.939122:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+12:11378:x1875823921494656:12345-192.168.204.28@tcp:101:llapi_scan_chan.0 Request processed in 22425us (22753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925396.939129:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:1.0:1788925396.953814:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925396.953923:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921495168 00000100:00100000:2.0:1788925396.953937:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921495168 00000100:00100000:2.0:1788925396.954017:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:2.0:1788925396.954031:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c85f9ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+12:11378:x1875823921495168:12345-192.168.204.28@tcp:53:llapi_scan_chan.0 00000004:00000080:2.0:1788925396.954085:0:5848:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff98c85804e308 00000040:00080000:2.0:1788925396.954209:0:5848:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788925396.954215:0:5848:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1788925396.954314:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788925396.954324:0:5848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1788925396.954464:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c85f9ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5652db64-8dca-43c9-a8d1-41118f535cbb+12:11378:x1875823921495168:12345-192.168.204.28@tcp:53:llapi_scan_chan.0 Request processed in 426us (654us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788925396.954507:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 55 00010000:00010000:3.0:1788925397.846756:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925398.870865:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788925399.092043:0:12088:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_157d: @@@@@@ FAIL: llapi_scan_changelog_test failed 00010000:00010000:3.0:1788925399.895098:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925400.687324:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925400.687489:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788925400.687521:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788925400.693354:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921495424 00000100:00100000:2.0:1788925400.693376:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921495424 00000100:00100000:2.0:1788925400.693510:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 133 00000100:00100000:2.0:1788925400.693528:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e48bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+12:2359:x1875823921495424:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788925400.693651:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e48bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5652db64-8dca-43c9-a8d1-41118f535cbb+12:2359:x1875823921495424:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 130us (6161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925400.693660:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 133 00000100:00100000:2.0:1788925400.693715:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921495680 00000100:00100000:2.0:1788925400.693720:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921495680 00000100:00100000:2.0:1788925400.693769:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:2.0:1788925400.693776:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c86e48a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2359:x1875823921495680:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788925400.693808:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c86e48a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5652db64-8dca-43c9-a8d1-41118f535cbb+5:2359:x1875823921495680:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 32us (6285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925400.693814:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00080000:2.0:1788925400.693832:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788925400.693839:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925400.705528:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921495296 00000100:00100000:3.0:1788925400.705550:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921495296 00000100:00100000:3.0:1788925400.705629:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 254 00000100:00100000:3.0:1788925400.705641:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c846161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2358:x1875823921495296:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925400.711651:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c846161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9daa795-437c-4e56-9ebb-89af76979400+10:2358:x1875823921495296:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 5992us (24322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925400.711670:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 254 00000100:00100000:2.0:1788925400.724247:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788925400.724672:0:12049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823921495552 00000100:00100000:3.0:1788925400.724687:0:12049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823921495552 00000100:00100000:3.0:1788925400.724884:0:12049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:3.0:1788925400.724897:0:12049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c868ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2358:x1875823921495552:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788925400.725186:0:12049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c868ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5652db64-8dca-43c9-a8d1-41118f535cbb+6:2358:x1875823921495552:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 290us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925400.725196:0:12049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00080000:2.0:1788925400.726133:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788925400.919666:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 11450 lines, 11450 kept, 0 dropped, 0 bad.